Aug 04 17:58:53.567834 ip-10-0-128-114 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 17:58:53.567845 ip-10-0-128-114 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 17:58:53.567853 ip-10-0-128-114 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 17:58:53.568156 ip-10-0-128-114 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 17:59:03.715827 ip-10-0-128-114 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 17:59:03.715847 ip-10-0-128-114 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7dd8aa4668a548a8aae4f1aab4beadb3 --
Aug 04 18:00:57.428220 ip-10-0-128-114 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 18:00:57.896833 ip-10-0-128-114 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:00:57.896833 ip-10-0-128-114 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 18:00:57.896833 ip-10-0-128-114 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:00:57.896833 ip-10-0-128-114 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 18:00:57.896833 ip-10-0-128-114 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:00:57.897885 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.897787    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 18:00:57.903021 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903003    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.903021 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903020    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903024    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903028    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903033    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903036    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903039    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903043    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903046    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903048    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903051    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903054    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903057    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903060    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903069    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903073    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903075    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903078    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903081    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903084    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903087    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.903094 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903089    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903092    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903096    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903099    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903102    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903108    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903112    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903115    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903118    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903125    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903128    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903131    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903134    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903137    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903139    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903142    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903145    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903148    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903150    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.903720 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903155    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903158    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903161    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903164    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903167    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903170    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903173    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903182    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903185    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903188    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903190    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903193    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903195    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903199    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903203    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903206    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903209    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903212    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903215    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903218    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.904597 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903221    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903224    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903227    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903230    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903232    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903235    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903238    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903241    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903244    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903246    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903249    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903252    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903255    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903258    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903261    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903264    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903267    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903272    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903276    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903279    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.905485 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903337    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903748    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903758    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903766    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903777    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903786    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903796    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903806    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903813    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903821    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903830    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903838    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903847    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903855    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903871    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903880    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903887    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903895    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.903904    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.905946    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.906441 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.905977    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.905985    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.905990    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.905995    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906000    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906005    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906011    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906016    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906021    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906025    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906031    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906036    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906040    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906045    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906050    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906054    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906059    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906064    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906068    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906073    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.907360 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906077    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906082    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906086    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906091    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906096    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906100    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906105    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906110    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906114    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906133    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906141    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906147    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906155    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906160    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906165    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906169    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906174    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906179    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906184    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.908326 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906189    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906193    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906198    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906202    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906207    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906213    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906220    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906224    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906229    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906233    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906239    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906244    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906248    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906259    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906265    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906271    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906276    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906280    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906285    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.909349 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906290    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906295    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906299    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906304    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906308    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906314    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906320    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906326    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906331    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906335    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906340    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906344    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906349    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906353    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906358    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906368    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906374    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906380    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906385    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.910057 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906390    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906396    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906401    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906407    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906412    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906417    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906421    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906426    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906430    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906435    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906439    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906443    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906448    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906453    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906457    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906462    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906467    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906472    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906477    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906484    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.910712 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.906489    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907210    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907220    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907226    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907231    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907236    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907241    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907246    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907251    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907256    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907260    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907265    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907270    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907275    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907279    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907284    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907289    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907294    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907298    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907303    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.911382 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907307    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907313    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907317    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907322    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907326    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907332    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907336    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907341    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907349    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907354    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907359    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907364    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907369    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907373    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907377    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907382    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907386    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907391    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907395    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907400    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.911903 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907405    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907410    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907414    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907419    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907424    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907428    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907433    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907437    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907442    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907447    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907456    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907463    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907471    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907476    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907482    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907486    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907491    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907496    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907501    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907506    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.912576 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907513    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907518    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907523    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907527    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907532    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907537    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907543    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907548    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907553    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907557    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907562    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907566    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907571    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907575    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907580    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907585    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907589    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907594    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907599    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.913157 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907603    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907608    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907613    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907617    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907622    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907626    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907634    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907639    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907643    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907648    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907653    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907657    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907662    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907670    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907677    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907682    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907687    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907692    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907698    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.913672 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907703    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.907707    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907820    2580 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907832    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907842    2580 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907850    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907858    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907863    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907871    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907878    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907884    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907889    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907895    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907901    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907907    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907912    2580 flags.go:64] FLAG: --cgroup-root=""
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907917    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907923    2580 flags.go:64] FLAG: --client-ca-file=""
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907928    2580 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907933    2580 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907941    2580 flags.go:64] FLAG: --cluster-domain=""
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907946    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907952    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907958    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 18:00:57.914189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907982    2580 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907989    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.907997    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908002    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908008    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908013    2580 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908019    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908024    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908037    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908043    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908050    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908056    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908061    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908066    2580 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908072    2580 flags.go:64] FLAG: --enable-server="true"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908077    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908085    2580 flags.go:64] FLAG: --event-burst="100"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908090    2580 flags.go:64] FLAG: --event-qps="50"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908095    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908101    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908106    2580 flags.go:64] FLAG: --eviction-hard=""
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908112    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908118    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908125    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908130    2580 flags.go:64] FLAG: --eviction-soft=""
Aug 04 18:00:57.914807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908135    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908140    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908145    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908150    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908155    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908160    2580 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908165    2580 flags.go:64] FLAG: --feature-gates=""
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908171    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908181    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908188    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908193    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908198    2580 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908204    2580 flags.go:64] FLAG: --help="false"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908209    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908215    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908220    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908226    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908232    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908239    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908244    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908249    2580 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908254    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908259    2580 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 18:00:57.915544 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908264    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908270    2580 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908275    2580 flags.go:64] FLAG: --kube-reserved=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908280    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908285    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908291    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908296    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908301    2580 flags.go:64] FLAG: --lock-file=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908306    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908311    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908316    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908326    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908331    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908336    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908340    2580 flags.go:64] FLAG: --logging-format="text"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908345    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908350    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908357    2580 flags.go:64] FLAG: --manifest-url=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908363    2580 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908371    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908377    2580 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908394    2580 flags.go:64] FLAG: --max-pods="110"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908400    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908405    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908418    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 18:00:57.916234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908423    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908431    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908437    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908442    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908455    2580 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908460    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908466    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908472    2580 flags.go:64] FLAG: --pod-cidr=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908477    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908486    2580 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908491    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908496    2580 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908501    2580 flags.go:64] FLAG: --port="10250"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908507    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908512    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025cf721e7586995e"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908518    2580 flags.go:64] FLAG: --qos-reserved=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908523    2580 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908529    2580 flags.go:64] FLAG: --register-node="true"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908534    2580 flags.go:64] FLAG: --register-with-taints=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908541    2580 flags.go:64] FLAG: --registry-burst="10"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908546    2580 flags.go:64] FLAG: --registry-qps="5"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908551    2580 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908556    2580 flags.go:64] FLAG: --reserved-memory=""
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908563    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908569    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 18:00:57.916944 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908576    2580 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908582    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908587    2580 flags.go:64] FLAG: --runonce="false"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908592    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908598    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908604    2580 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908609    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908614    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908620    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908626    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908631    2580 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908636    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908642    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908647    2580 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908652    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908658    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908663    2580 flags.go:64] FLAG: --system-cgroups=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908668    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908677    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908682    2580 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908687    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908696    2580 flags.go:64] FLAG: --tls-min-version=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908701    2580 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908706    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908711    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 18:00:57.917634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908716    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908721    2580 flags.go:64] FLAG: --v="2"
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908728    2580 flags.go:64] FLAG: --version="false"
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908736    2580 flags.go:64] FLAG: --vmodule=""
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908743    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.908748    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.908995    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909005    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909011    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909016    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909020    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909025    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909030    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909036    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909041    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909046    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909050    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909056    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909060    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909065    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909070    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.918328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909074    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909079    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909084    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909089    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909093    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909098    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909102    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909107    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909111    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909116    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909121    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909125    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909130    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909135    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909139    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909144    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909148    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909153    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909160    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909165    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.918888 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909170    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909175    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909180    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909184    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909189    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909193    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909198    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909218    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909223    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909233    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909238    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909243    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909247    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909252    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909256    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909261    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909264    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909269    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909273    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909277    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.919449 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909281    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909286    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909292    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909297    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909302    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909308    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909313    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909318    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909323    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909330    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909336    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909341    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909345    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909350    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909354    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909359    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909363    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909367    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909371    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.919988 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909376    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909380    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909385    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909390    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909395    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909400    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909404    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909410    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909415    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909419    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909424    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909429    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909435    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909443    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909451    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909456    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909461    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909466    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909472    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.920493 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909477    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909482    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909487    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909493    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909501    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.909505    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.909561    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.917652    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.917670    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.917691    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.917698    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917764    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917769    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917772    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917776    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.921003 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917779    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917787    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917790    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917796    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917800    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917803    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917807    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917810    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917814    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917817    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917820    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917823    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917826    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917829    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917832    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917836    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917840    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917843    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917846    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.921420 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917850    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917853    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917856    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917860    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917863    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917866    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917871    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917874    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917878    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917881    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917884    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917887    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917889    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917893    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917895    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917901    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917904    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917907    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917910    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917913    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.921921 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917915    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917918    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917921    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917924    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917926    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917930    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917933    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917936    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917939    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917941    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917944    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917947    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917950    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917955    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917958    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917961    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917976    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917979    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917983    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917986    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.922504 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917989    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917992    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917995    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.917999    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918003    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918007    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918010    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918013    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918021    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918024    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918027    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918030    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918033    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918036    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918039    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918042    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918045    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918048    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918050    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918054    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.923045 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918057    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918059    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918062    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918065    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918068    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918071    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918074    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918076    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918079    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918082    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918085    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918089    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918091    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918095    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918098    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.923559 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918100    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.918106    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918255    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918261    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918266    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918269    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918273    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918276    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918279    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918282    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918285    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918288    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918291    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918293    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:00:57.923943 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918296    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918299    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918301    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918304    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918307    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918310    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918313    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918316    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918318    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918321    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918324    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918327    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918330    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918334    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918337    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918340    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918343    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918346    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918349    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918351    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:00:57.924404 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918354    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918357    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918360    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918363    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918365    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918371    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918374    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918377    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918380    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918382    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918385    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918388    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918391    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918393    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918396    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918399    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918401    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918404    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918407    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918410    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:00:57.924939 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918412    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918415    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918418    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918421    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918424    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918427    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918432    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918435    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918438    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918441    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918444    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918446    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918449    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918452    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918455    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918457    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918460    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918463    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918472    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918475    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:00:57.925468 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918478    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918480    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918483    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918486    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918489    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918491    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918494    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918500    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918503    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918505    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918508    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918510    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918513    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918516    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918519    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918521    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918524    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918528    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918530    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:00:57.926024 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918533    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918536    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918539    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918541    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918544    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918547    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:57.918550    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.918555    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.918686    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.921059    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.922740    2580 server.go:1019] "Starting client certificate rotation"
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.922850    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.922906    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:00:57.926579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.926311    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:00:57.932018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.931994    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:00:57.948674 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.948655    2580 log.go:25] "Validated CRI v1 runtime API"
Aug 04 18:00:57.950943 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.950925    2580 log.go:25] "Validated CRI v1 image API"
Aug 04 18:00:57.951865 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.951850    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 18:00:57.956675 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.956655    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:00:57.959299 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.959276    2580 fs.go:135] Filesystem UUIDs: map[5577513e-adf4-410c-b573-35ad1e1c7de7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8d243035-af2d-4fdc-a444-e91917f64ff0:/dev/nvme0n1p4]
Aug 04 18:00:57.959398 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.959298    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 18:00:57.964465 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.964332    2580 manager.go:216] Machine: {Timestamp:2026-08-04 18:00:57.963791493 +0000 UTC m=+0.405943779 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104082 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23dc3a8d703e5904c1fa882a7a7060 SystemUUID:ec23dc3a-8d70-3e59-04c1-fa882a7a7060 BootID:7dd8aa46-68a5-48a8-aae4-f1aab4beadb3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:8b:ca:b9:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:8b:ca:b9:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:4e:9c:79:67:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 18:00:57.964465 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.964449    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 18:00:57.964642 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.964572    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 18:00:57.969127 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.969079    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 18:00:57.969322 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.969133    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 18:00:57.970742 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.970729    2580 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 18:00:57.970803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.970751    2580 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 18:00:57.970803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.970764    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:00:57.970803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.970785    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:00:57.971761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.971748    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 18:00:57.976847 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.976832    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:00:57.977011 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977000    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 18:00:57.977075 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977043    2580 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 18:00:57.977075 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977058    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 18:00:57.977185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977081    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 18:00:57.977185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977099    2580 kubelet.go:398] "Adding apiserver pod source"
Aug 04 18:00:57.977185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977113    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 18:00:57.977550 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977534    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:00:57.977614 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.977560    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:00:57.980375 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.980352    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 18:00:57.982252 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.982235    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 18:00:57.982308 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.982290    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 18:00:57.983914 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.983900    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 18:00:57.983951 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.983931    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 18:00:57.983996 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.983942    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 18:00:57.983996 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.983984    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 18:00:57.983996 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.983994    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984000    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984009    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984014    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984022    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984028    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984037    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 18:00:57.984088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984043    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 18:00:57.984461 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.984445    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4p8k"
Aug 04 18:00:57.985067 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.985055    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 18:00:57.985102 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.985068    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 18:00:57.988780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.988761    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 18:00:57.988918 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:57.988898    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 18:00:57.988989 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:57.988896    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 18:00:57.989255 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.989241    2580 server.go:1268] "Started kubelet"
Aug 04 18:00:57.989369 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.989337    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 18:00:57.990175 ip-10-0-128-114 systemd[1]: Started Kubernetes Kubelet.
Aug 04 18:00:57.990316 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.990218    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 18:00:57.990316 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.990313    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 18:00:57.995921 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.995862    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 18:00:57.996026 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.995931    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4p8k"
Aug 04 18:00:57.996240 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:57.996224    2580 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 18:00:57.996937 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:57.996871    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 18:00:57.999925 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:57.998768    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-114.ec2.internal.18c8ac14e4bb4128  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-114.ec2.internal,UID:ip-10-0-128-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-114.ec2.internal,},FirstTimestamp:2026-08-04 18:00:57.989202216 +0000 UTC m=+0.431354500,LastTimestamp:2026-08-04 18:00:57.989202216 +0000 UTC m=+0.431354500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-114.ec2.internal,}"
Aug 04 18:00:58.003498 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.003448    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 18:00:58.003498 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.003453    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 18:00:58.003629 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.003575    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.004217 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004165    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 18:00:58.004217 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004198    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 18:00:58.004217 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004214    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 18:00:58.004514 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004303    2580 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 18:00:58.004514 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004314    2580 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 18:00:58.004721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004521    2580 factory.go:55] Registering systemd factory
Aug 04 18:00:58.004721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004540    2580 factory.go:223] Registration of the systemd container factory successfully
Aug 04 18:00:58.004826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004802    2580 factory.go:153] Registering CRI-O factory
Aug 04 18:00:58.004826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004820    2580 factory.go:223] Registration of the crio container factory successfully
Aug 04 18:00:58.004925 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004877    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 18:00:58.004925 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004904    2580 factory.go:103] Registering Raw factory
Aug 04 18:00:58.005044 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.004943    2580 manager.go:1196] Started watching for new ooms in manager
Aug 04 18:00:58.005670 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.005656    2580 manager.go:349] Starting recovery of all containers
Aug 04 18:00:58.014125 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.014103    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:00:58.017101 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.016913    2580 manager.go:354] Recovery completed
Aug 04 18:00:58.018143 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.018123    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-114.ec2.internal\" not found" node="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.021462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.021449    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.023457 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.023442    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.023534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.023471    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.023534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.023484    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.024094 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024079    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 18:00:58.024094 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024091    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 18:00:58.024227 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024109    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.024227 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024111    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:00:58.024850 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024834    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.024920 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024862    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.024920 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.024872    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.025467 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.025455    2580 policy_none.go:49] "None policy: Start"
Aug 04 18:00:58.025508 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.025471    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 18:00:58.025508 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.025483    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 18:00:58.026576 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.026558    2580 policy_none.go:47] "Start"
Aug 04 18:00:58.069537 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.069516    2580 manager.go:337] "Starting Device Plugin manager"
Aug 04 18:00:58.069644 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.069562    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 18:00:58.069644 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.069573    2580 server.go:87] "Starting device plugin registration server"
Aug 04 18:00:58.069866 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.069846    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 18:00:58.069994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.069862    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 18:00:58.069994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.069975    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 18:00:58.070104 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.070071    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 18:00:58.070104 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.070081    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 18:00:58.070685 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.070666    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 18:00:58.070768 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.070723    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.138849 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.138808    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 18:00:58.140171 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.140157    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 18:00:58.140247 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.140195    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 18:00:58.140247 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.140229    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 18:00:58.140326 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.140277    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 18:00:58.142517 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.142491    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:00:58.170525 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.170485    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.171620 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.171598    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.171700 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.171635    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.171700 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.171648    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.171700 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.171672    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.180389 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.180369    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.180487 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.180393    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-114.ec2.internal\": node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.197698 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.197675    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.242350 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.242301    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"]
Aug 04 18:00:58.242476 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.242396    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.243439 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.243422    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.243517 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.243457    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.243517 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.243474    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.245207 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245193    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.245343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.245395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245361    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.245955 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245938    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.246047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245967    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.246047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245994    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.246047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.246010    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.246047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.245971    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.246189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.246084    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.247871 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.247852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.247989 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.247883    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:00:58.248580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.248565    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:00:58.248657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.248595    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:00:58.248657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.248607    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:00:58.275818 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.275762    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-114.ec2.internal\" not found" node="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.280487 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.280470    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-114.ec2.internal\" not found" node="ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.298708 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.298688    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.306760 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.306741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.306837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.306767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.306837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.306789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b8da014694864829d0e8663a754d2a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-114.ec2.internal\" (UID: \"6b8da014694864829d0e8663a754d2a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.399964 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.399925    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.407772 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.407845 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b8da014694864829d0e8663a754d2a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-114.ec2.internal\" (UID: \"6b8da014694864829d0e8663a754d2a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.407845 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.407946 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.407946 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b8da014694864829d0e8663a754d2a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-114.ec2.internal\" (UID: \"6b8da014694864829d0e8663a754d2a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.407946 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.407845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e9a61a639b79c945f24c1d4bade66ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal\" (UID: \"6e9a61a639b79c945f24c1d4bade66ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.500823 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.500784    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.583681 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.583610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.583763 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.583610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:58.601256 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.601228    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.703546 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.703491    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.810921 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.810875    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.912096 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:58.912023    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:58.921884 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.921856    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 18:00:58.922079 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.922044    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:00:58.922130 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:58.922085    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:00:59.002120 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.002083    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 17:55:58 +0000 UTC" deadline="2028-02-25 00:25:07.935358404 +0000 UTC"
Aug 04 18:00:59.002120 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.002116    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13662h24m8.933247267s"
Aug 04 18:00:59.012427 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:59.012407    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:59.108577 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.108543    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:00:59.113333 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:59.113309    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:59.165070 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:00:59.165002    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9a61a639b79c945f24c1d4bade66ac.slice/crio-ea7e2f50b83d965a6926c0651f9050ae18f37da7f2be1e2f6199d3bc68fc16fb WatchSource:0}: Error finding container ea7e2f50b83d965a6926c0651f9050ae18f37da7f2be1e2f6199d3bc68fc16fb: Status 404 returned error can't find the container with id ea7e2f50b83d965a6926c0651f9050ae18f37da7f2be1e2f6199d3bc68fc16fb
Aug 04 18:00:59.168576 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.168558    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:00:59.214514 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:00:59.214483    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-114.ec2.internal\" not found"
Aug 04 18:00:59.267151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.267126    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:00:59.305450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.305415    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:59.318755 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.318731    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:00:59.321445 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.321431    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal"
Aug 04 18:00:59.335345 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.335323    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:00:59.978094 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.978057    2580 apiserver.go:52] "Watching apiserver"
Aug 04 18:00:59.989258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.989236    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 18:00:59.989660 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.989636    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2hs4r","openshift-dns/node-resolver-whsbv","openshift-image-registry/node-ca-k5q72","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal","openshift-multus/multus-additional-cni-plugins-8dhw2","openshift-network-diagnostics/network-check-target-fsgwg","kube-system/global-pull-secret-syncer-hbnsn","kube-system/konnectivity-agent-kxzh4","kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal","openshift-multus/multus-k6bww","openshift-multus/network-metrics-daemon-wfgkp","openshift-network-operator/iptables-alerter-xp4v2","openshift-ovn-kubernetes/ovnkube-node-czvw8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"]
Aug 04 18:00:59.991837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.991819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k6bww"
Aug 04 18:00:59.993623 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.993502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:00:59.996293 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.996272    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 18:00:59.996667 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.996649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:00:59.997981 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.997956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:00:59.998254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.998144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 18:00:59.998254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.998209    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 18:00:59.998483 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.998466    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 18:00:59.998614 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.998590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nd8mb\""
Aug 04 18:00:59.998732 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.998699    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mnkb8\""
Aug 04 18:00:59.999283 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.999260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:00:59.999377 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.999357    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 18:00:59.999490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:00:59.999472    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.000265 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.000373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000287    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 18:01:00.000373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 18:01:00.000373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000287    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.000373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000326    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 18:01:00.000373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 18:01:00.000680 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 18:01:00.000763 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.000744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:00.000999 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.000821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:00.001149 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.001130    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rnb46\""
Aug 04 18:01:00.001641 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.001625    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 18:01:00.001956 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.001939    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.002202 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.002185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.003206 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.003190    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 18:01:00.003302 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.003286    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 18:01:00.003464 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.003448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jxmhw\""
Aug 04 18:01:00.003583 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.003567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.003650 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.003622    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:00.003768 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.003717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7v2s4\""
Aug 04 18:01:00.004531 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.004507    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 18:01:00.005095 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.005076    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 18:01:00.005196 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.005179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mgmx\""
Aug 04 18:01:00.005280 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.005262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 18:01:00.005416 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.005401    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 18:01:00.005679 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.005660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.006993 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.006978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.008485 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.008465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.008578 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.008518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ttb85\""
Aug 04 18:01:00.008578 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.008535    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:00.008797 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.008777    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 18:01:00.008879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.008784    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.009749 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.009733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pwk2m\""
Aug 04 18:01:00.009878 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.009864    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.010385 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.010365    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.010438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.010413    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:01:00.013180 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.013163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j5szz\""
Aug 04 18:01:00.013717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.013703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 18:01:00.013954 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.013938    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 18:01:00.014019 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.013972    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:01:00.018838 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.018818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-sys-fs\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.018931 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.018856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcftw\" (UniqueName: \"kubernetes.io/projected/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-kube-api-access-xcftw\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.018931 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.018884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-var-lib-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019024 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.018935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-bin\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019073 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019073 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-netns\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-multus\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-socket-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.019158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-os-release\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.019158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6468326b-f7ea-4a7f-8b90-672a176e226d-tmp-dir\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.019158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-log-socket\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-kubelet\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqflz\" (UniqueName: \"kubernetes.io/projected/e7f52a46-bea7-4d80-b589-d55ab394609b-kube-api-access-hqflz\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cni-binary-copy\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-multus-certs\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cnibin\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.019338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-script-lib\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-registration-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-agent-certs\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019433    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfc5\" (UniqueName: \"kubernetes.io/projected/6468326b-f7ea-4a7f-8b90-672a176e226d-kube-api-access-lrfc5\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-ovn\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-slash\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-netns\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-os-release\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftjk\" (UniqueName: \"kubernetes.io/projected/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-kube-api-access-sftjk\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-systemd-units\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.019668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-etc-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00d51c67-94ff-4aa2-8eb1-5de80210655c-host\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-daemon-config\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-node-log\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7f52a46-bea7-4d80-b589-d55ab394609b-ovn-node-metrics-cert\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-dbus\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cnibin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-bin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445jx\" (UniqueName: \"kubernetes.io/projected/03726312-770d-4c49-9b4c-d67465a83d00-kube-api-access-445jx\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-kubelet-config\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.019981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-konnectivity-ca\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6468326b-f7ea-4a7f-8b90-672a176e226d-hosts-file\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-netd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020228 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zz7j\" (UniqueName: \"kubernetes.io/projected/00d51c67-94ff-4aa2-8eb1-5de80210655c-kube-api-access-4zz7j\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-system-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-k8s-cni-cncf-io\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-hostroot\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-device-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-env-overrides\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-config\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00d51c67-94ff-4aa2-8eb1-5de80210655c-serviceca\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-socket-dir-parent\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-kubelet\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-system-cni-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-systemd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-conf-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.020780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.020403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-etc-kubernetes\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.021462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.021356    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:01:00.041574 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.041550    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8nb2"
Aug 04 18:01:00.053134 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.053118    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8nb2"
Aug 04 18:01:00.105210 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.105189    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 18:01:00.120865 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-sys\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.120990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.120990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcftw\" (UniqueName: \"kubernetes.io/projected/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-kube-api-access-xcftw\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.120990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-systemd\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.120990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-var-lib-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.120994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-bin\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-netns\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-bin\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-var-lib-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-multus\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-socket-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-os-release\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-netns\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6468326b-f7ea-4a7f-8b90-672a176e226d-tmp-dir\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-tmp\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-log-socket\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-socket-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-kubelet\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-multus\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-kubernetes\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-log-socket\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-host\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-os-release\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-kubelet\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqflz\" (UniqueName: \"kubernetes.io/projected/e7f52a46-bea7-4d80-b589-d55ab394609b-kube-api-access-hqflz\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cni-binary-copy\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-multus-certs\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cnibin\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.121879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6468326b-f7ea-4a7f-8b90-672a176e226d-tmp-dir\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-script-lib\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-multus-certs\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-registration-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-registration-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-agent-certs\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-tuned\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cnibin\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfc5\" (UniqueName: \"kubernetes.io/projected/6468326b-f7ea-4a7f-8b90-672a176e226d-kube-api-access-lrfc5\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdgj\" (UniqueName: \"kubernetes.io/projected/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-kube-api-access-hbdgj\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-ovn\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-ovn\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-slash\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-slash\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.122587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.121955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-iptables-alerter-script\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-netns\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122030    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cni-binary-copy\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-os-release\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-run-netns\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sftjk\" (UniqueName: \"kubernetes.io/projected/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-kube-api-access-sftjk\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-systemd-units\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-script-lib\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-etc-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00d51c67-94ff-4aa2-8eb1-5de80210655c-host\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00d51c67-94ff-4aa2-8eb1-5de80210655c-host\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-os-release\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-daemon-config\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.123395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-etc-openvswitch\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-systemd-units\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-node-log\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7f52a46-bea7-4d80-b589-d55ab394609b-ovn-node-metrics-cert\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-dbus\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-node-log\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-dbus\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cnibin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-bin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-cni-bin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-cnibin\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.122657    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445jx\" (UniqueName: \"kubernetes.io/projected/03726312-770d-4c49-9b4c-d67465a83d00-kube-api-access-445jx\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.122738    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:00.622709179 +0000 UTC m=+3.064861466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-kubelet-config\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.124246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-daemon-config\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-konnectivity-ca\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6468326b-f7ea-4a7f-8b90-672a176e226d-hosts-file\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff9905c6-8e42-4f1c-ae89-030cc80dc053-kubelet-config\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-conf\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-lib-modules\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6468326b-f7ea-4a7f-8b90-672a176e226d-hosts-file\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.122996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-netd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-host-cni-netd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zz7j\" (UniqueName: \"kubernetes.io/projected/00d51c67-94ff-4aa2-8eb1-5de80210655c-kube-api-access-4zz7j\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-system-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-k8s-cni-cncf-io\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-hostroot\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-run-k8s-cni-cncf-io\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-hostroot\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.124811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-system-cni-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-device-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-var-lib-kubelet\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-device-dir\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-env-overrides\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-modprobe-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysconfig\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7sn\" (UniqueName: \"kubernetes.io/projected/08e6a5a3-0206-4079-97c3-6c0fde69b891-kube-api-access-6m7sn\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85xps\" (UniqueName: \"kubernetes.io/projected/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-kube-api-access-85xps\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123450    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-konnectivity-ca\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-config\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00d51c67-94ff-4aa2-8eb1-5de80210655c-serviceca\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-socket-dir-parent\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-kubelet\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-system-cni-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.125507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-run\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-host-slash\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-socket-dir-parent\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-systemd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-system-cni-dir\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-conf-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-env-overrides\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-etc-kubernetes\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-sys-fs\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-host-var-lib-kubelet\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.123996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7f52a46-bea7-4d80-b589-d55ab394609b-run-systemd\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7f52a46-bea7-4d80-b589-d55ab394609b-ovnkube-config\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03726312-770d-4c49-9b4c-d67465a83d00-sys-fs\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-multus-conf-dir\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-etc-kubernetes\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00d51c67-94ff-4aa2-8eb1-5de80210655c-serviceca\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.126198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.124586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.126738 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.125694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7f52a46-bea7-4d80-b589-d55ab394609b-ovn-node-metrics-cert\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.126738 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.125916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5671e75c-a64c-4b9f-89bc-c5c7e6627d46-agent-certs\") pod \"konnectivity-agent-kxzh4\" (UID: \"5671e75c-a64c-4b9f-89bc-c5c7e6627d46\") " pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.130141 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.130120    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:00.130241 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.130149    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:00.130241 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.130163    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:00.130241 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.130234    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:00.630216763 +0000 UTC m=+3.072369055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:00.132169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.132141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftjk\" (UniqueName: \"kubernetes.io/projected/7ff1ef1e-d99e-4333-9d9c-243c0a09df12-kube-api-access-sftjk\") pod \"multus-additional-cni-plugins-8dhw2\" (UID: \"7ff1ef1e-d99e-4333-9d9c-243c0a09df12\") " pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.132530 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.132506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfc5\" (UniqueName: \"kubernetes.io/projected/6468326b-f7ea-4a7f-8b90-672a176e226d-kube-api-access-lrfc5\") pod \"node-resolver-whsbv\" (UID: \"6468326b-f7ea-4a7f-8b90-672a176e226d\") " pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.132622 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.132525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqflz\" (UniqueName: \"kubernetes.io/projected/e7f52a46-bea7-4d80-b589-d55ab394609b-kube-api-access-hqflz\") pod \"ovnkube-node-czvw8\" (UID: \"e7f52a46-bea7-4d80-b589-d55ab394609b\") " pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.132622 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.132615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcftw\" (UniqueName: \"kubernetes.io/projected/0e0f3ac3-6af0-4e9f-aabe-7336108473b3-kube-api-access-xcftw\") pod \"multus-k6bww\" (UID: \"0e0f3ac3-6af0-4e9f-aabe-7336108473b3\") " pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.133038 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.133018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-445jx\" (UniqueName: \"kubernetes.io/projected/03726312-770d-4c49-9b4c-d67465a83d00-kube-api-access-445jx\") pod \"aws-ebs-csi-driver-node-b7bhh\" (UID: \"03726312-770d-4c49-9b4c-d67465a83d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.133727 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.133706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zz7j\" (UniqueName: \"kubernetes.io/projected/00d51c67-94ff-4aa2-8eb1-5de80210655c-kube-api-access-4zz7j\") pod \"node-ca-k5q72\" (UID: \"00d51c67-94ff-4aa2-8eb1-5de80210655c\") " pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.144943 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.144892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal" event={"ID":"6e9a61a639b79c945f24c1d4bade66ac","Type":"ContainerStarted","Data":"ea7e2f50b83d965a6926c0651f9050ae18f37da7f2be1e2f6199d3bc68fc16fb"}
Aug 04 18:01:00.224333 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdgj\" (UniqueName: \"kubernetes.io/projected/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-kube-api-access-hbdgj\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.224333 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-iptables-alerter-script\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-conf\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-lib-modules\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-var-lib-kubelet\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-modprobe-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysconfig\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysctl-conf\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.224580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7sn\" (UniqueName: \"kubernetes.io/projected/08e6a5a3-0206-4079-97c3-6c0fde69b891-kube-api-access-6m7sn\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-lib-modules\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-sysconfig\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-var-lib-kubelet\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-modprobe-d\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85xps\" (UniqueName: \"kubernetes.io/projected/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-kube-api-access-85xps\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-run\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-host-slash\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-run\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.224760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-sys\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-sys\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-systemd\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-host-slash\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-tmp\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-kubernetes\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-systemd\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.225414    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-host\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-host\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.225502 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.225492    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:00.725474112 +0000 UTC m=+3.167626383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:00.226104 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-iptables-alerter-script\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.226104 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-kubernetes\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.226104 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.225580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-tuned\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.228721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.228651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-tmp\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.229312 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.229289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08e6a5a3-0206-4079-97c3-6c0fde69b891-etc-tuned\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.237126 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.237094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdgj\" (UniqueName: \"kubernetes.io/projected/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-kube-api-access-hbdgj\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.238293 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.238271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7sn\" (UniqueName: \"kubernetes.io/projected/08e6a5a3-0206-4079-97c3-6c0fde69b891-kube-api-access-6m7sn\") pod \"tuned-2hs4r\" (UID: \"08e6a5a3-0206-4079-97c3-6c0fde69b891\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.238398 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.238381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85xps\" (UniqueName: \"kubernetes.io/projected/faa59f9e-f492-4ac4-931c-f0e168bcc7e6-kube-api-access-85xps\") pod \"iptables-alerter-xp4v2\" (UID: \"faa59f9e-f492-4ac4-931c-f0e168bcc7e6\") " pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.305244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.305221    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k6bww"
Aug 04 18:01:00.311645 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.311558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:00.315044 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.315025    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0f3ac3_6af0_4e9f_aabe_7336108473b3.slice/crio-665152eb8de6c5e69504238c3333677c5b8b3051441cdd30b4e438da2e803b0f WatchSource:0}: Error finding container 665152eb8de6c5e69504238c3333677c5b8b3051441cdd30b4e438da2e803b0f: Status 404 returned error can't find the container with id 665152eb8de6c5e69504238c3333677c5b8b3051441cdd30b4e438da2e803b0f
Aug 04 18:01:00.319129 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.319106    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f52a46_bea7_4d80_b589_d55ab394609b.slice/crio-c6e17a7a417ce2a8a1116131f8d7e741b1e29c75ec91a64b784d63e60a8d4ea7 WatchSource:0}: Error finding container c6e17a7a417ce2a8a1116131f8d7e741b1e29c75ec91a64b784d63e60a8d4ea7: Status 404 returned error can't find the container with id c6e17a7a417ce2a8a1116131f8d7e741b1e29c75ec91a64b784d63e60a8d4ea7
Aug 04 18:01:00.319821 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.319804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5q72"
Aug 04 18:01:00.323584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.323567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh"
Aug 04 18:01:00.327373 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.327338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d51c67_94ff_4aa2_8eb1_5de80210655c.slice/crio-63cf0e334e53e7529fac747941a5bacad90020c44b71a4ff53380a30e1c854b7 WatchSource:0}: Error finding container 63cf0e334e53e7529fac747941a5bacad90020c44b71a4ff53380a30e1c854b7: Status 404 returned error can't find the container with id 63cf0e334e53e7529fac747941a5bacad90020c44b71a4ff53380a30e1c854b7
Aug 04 18:01:00.330910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.330887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dhw2"
Aug 04 18:01:00.332444 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.332422    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03726312_770d_4c49_9b4c_d67465a83d00.slice/crio-ca4d87d5e25e6483b0b42e5175951ec04bebc447fa2e06939edfdea5903a9e89 WatchSource:0}: Error finding container ca4d87d5e25e6483b0b42e5175951ec04bebc447fa2e06939edfdea5903a9e89: Status 404 returned error can't find the container with id ca4d87d5e25e6483b0b42e5175951ec04bebc447fa2e06939edfdea5903a9e89
Aug 04 18:01:00.337206 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.337185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:00.340561 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.340541    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff1ef1e_d99e_4333_9d9c_243c0a09df12.slice/crio-44cd9493143d5f3fcfbee244521fd9143a55735bc4d46815a2da1a7a05d017ef WatchSource:0}: Error finding container 44cd9493143d5f3fcfbee244521fd9143a55735bc4d46815a2da1a7a05d017ef: Status 404 returned error can't find the container with id 44cd9493143d5f3fcfbee244521fd9143a55735bc4d46815a2da1a7a05d017ef
Aug 04 18:01:00.342380 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.342357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whsbv"
Aug 04 18:01:00.345975 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.345953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5671e75c_a64c_4b9f_89bc_c5c7e6627d46.slice/crio-28dbf21469be9501fa46f6108eac4c3cacf37fbf0035461610053fe12e576132 WatchSource:0}: Error finding container 28dbf21469be9501fa46f6108eac4c3cacf37fbf0035461610053fe12e576132: Status 404 returned error can't find the container with id 28dbf21469be9501fa46f6108eac4c3cacf37fbf0035461610053fe12e576132
Aug 04 18:01:00.348071 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.348040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hs4r"
Aug 04 18:01:00.352327 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.352307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6468326b_f7ea_4a7f_8b90_672a176e226d.slice/crio-e071ede5279ca0be529885e3f4dd7b9758b5ca54cfddbd82cee9b08fc280edbf WatchSource:0}: Error finding container e071ede5279ca0be529885e3f4dd7b9758b5ca54cfddbd82cee9b08fc280edbf: Status 404 returned error can't find the container with id e071ede5279ca0be529885e3f4dd7b9758b5ca54cfddbd82cee9b08fc280edbf
Aug 04 18:01:00.356323 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.356305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xp4v2"
Aug 04 18:01:00.356542 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.356525    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e6a5a3_0206_4079_97c3_6c0fde69b891.slice/crio-0f057185ec5d9734c66d35584c2b672bbc005c4c534c5053d0f921cf74cb24b7 WatchSource:0}: Error finding container 0f057185ec5d9734c66d35584c2b672bbc005c4c534c5053d0f921cf74cb24b7: Status 404 returned error can't find the container with id 0f057185ec5d9734c66d35584c2b672bbc005c4c534c5053d0f921cf74cb24b7
Aug 04 18:01:00.364322 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.364303    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa59f9e_f492_4ac4_931c_f0e168bcc7e6.slice/crio-1f9af759f4e0c58617043a9683374a053c7b992555ac05234c7112b7edee3c05 WatchSource:0}: Error finding container 1f9af759f4e0c58617043a9683374a053c7b992555ac05234c7112b7edee3c05: Status 404 returned error can't find the container with id 1f9af759f4e0c58617043a9683374a053c7b992555ac05234c7112b7edee3c05
Aug 04 18:01:00.444552 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.444531    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:01:00.471338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.471321    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:01:00.629220 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.629139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:00.629359 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.629296    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:00.629401 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.629361    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:01.629346441 +0000 UTC m=+4.071498715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:00.729680 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.729641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:00.729885 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:00.729742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:00.729885 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729864    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:00.730018 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729889    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:00.730018 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729928    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:00.730018 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729942    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:00.730018 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:01.729918506 +0000 UTC m=+4.172070781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:00.730018 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:00.729989    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:01.729973015 +0000 UTC m=+4.172125285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:00.956442 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:00.956405    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8da014694864829d0e8663a754d2a1.slice/crio-4247690f41ed72c7bbb440630de153dadfffc76c3dda5044beac7abf9fa1972a WatchSource:0}: Error finding container 4247690f41ed72c7bbb440630de153dadfffc76c3dda5044beac7abf9fa1972a: Status 404 returned error can't find the container with id 4247690f41ed72c7bbb440630de153dadfffc76c3dda5044beac7abf9fa1972a
Aug 04 18:01:01.055972 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.055930    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:56:00 +0000 UTC" deadline="2028-02-16 17:56:41.840930424 +0000 UTC"
Aug 04 18:01:01.055972 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.055970    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13463h55m40.784965826s"
Aug 04 18:01:01.141334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.141301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:01.141509 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.141450    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:01.141930 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.141908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:01.142060 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.142023    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:01.153539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.153488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xp4v2" event={"ID":"faa59f9e-f492-4ac4-931c-f0e168bcc7e6","Type":"ContainerStarted","Data":"1f9af759f4e0c58617043a9683374a053c7b992555ac05234c7112b7edee3c05"}
Aug 04 18:01:01.156278 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.156250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hs4r" event={"ID":"08e6a5a3-0206-4079-97c3-6c0fde69b891","Type":"ContainerStarted","Data":"0f057185ec5d9734c66d35584c2b672bbc005c4c534c5053d0f921cf74cb24b7"}
Aug 04 18:01:01.158085 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.158061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whsbv" event={"ID":"6468326b-f7ea-4a7f-8b90-672a176e226d","Type":"ContainerStarted","Data":"e071ede5279ca0be529885e3f4dd7b9758b5ca54cfddbd82cee9b08fc280edbf"}
Aug 04 18:01:01.161356 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.161294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxzh4" event={"ID":"5671e75c-a64c-4b9f-89bc-c5c7e6627d46","Type":"ContainerStarted","Data":"28dbf21469be9501fa46f6108eac4c3cacf37fbf0035461610053fe12e576132"}
Aug 04 18:01:01.164751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.164722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh" event={"ID":"03726312-770d-4c49-9b4c-d67465a83d00","Type":"ContainerStarted","Data":"ca4d87d5e25e6483b0b42e5175951ec04bebc447fa2e06939edfdea5903a9e89"}
Aug 04 18:01:01.167373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.167351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k6bww" event={"ID":"0e0f3ac3-6af0-4e9f-aabe-7336108473b3","Type":"ContainerStarted","Data":"665152eb8de6c5e69504238c3333677c5b8b3051441cdd30b4e438da2e803b0f"}
Aug 04 18:01:01.169313 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.169287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal" event={"ID":"6b8da014694864829d0e8663a754d2a1","Type":"ContainerStarted","Data":"4247690f41ed72c7bbb440630de153dadfffc76c3dda5044beac7abf9fa1972a"}
Aug 04 18:01:01.171173 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.171148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerStarted","Data":"44cd9493143d5f3fcfbee244521fd9143a55735bc4d46815a2da1a7a05d017ef"}
Aug 04 18:01:01.172567 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.172522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5q72" event={"ID":"00d51c67-94ff-4aa2-8eb1-5de80210655c","Type":"ContainerStarted","Data":"63cf0e334e53e7529fac747941a5bacad90020c44b71a4ff53380a30e1c854b7"}
Aug 04 18:01:01.174454 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.174370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"c6e17a7a417ce2a8a1116131f8d7e741b1e29c75ec91a64b784d63e60a8d4ea7"}
Aug 04 18:01:01.638493 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.638434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:01.638683 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.638651    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:01.638755 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.638715    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:03.638696125 +0000 UTC m=+6.080848400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:01.739311 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.739272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:01.739508 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:01.739378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:01.739585 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.739518    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:01.739585 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.739583    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:03.739562068 +0000 UTC m=+6.181714344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:01.740095 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.740036    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:01.740095 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.740065    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:01.740095 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.740080    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:01.740311 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:01.740131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:03.740113939 +0000 UTC m=+6.182266210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:02.056375 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:02.056326    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:56:00 +0000 UTC" deadline="2028-02-20 08:09:40.834040955 +0000 UTC"
Aug 04 18:01:02.056375 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:02.056374    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13550h8m38.777672185s"
Aug 04 18:01:02.145166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:02.143098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:02.145166 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:02.143253    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:03.141205 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:03.141172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:03.141678 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.141299    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:03.141755 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:03.141700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:03.141816 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.141794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:03.657510 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:03.656921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:03.657510 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.657110    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:03.657510 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.657171    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:07.657152125 +0000 UTC m=+10.099304398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:03.757383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:03.757451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.757630    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.757647    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.757662    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.757718    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:07.757697182 +0000 UTC m=+10.199849456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.758153    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:03.758246 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:03.758207    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:07.758190128 +0000 UTC m=+10.200342402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:04.142747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:04.142154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:04.142747 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:04.142315    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:05.140633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:05.140601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:05.140830 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:05.140752    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:05.141225 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:05.141067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:05.141225 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:05.141184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:06.140725 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:06.140634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:06.141175 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:06.140789    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:07.140574 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:07.140544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:07.140761 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.140679    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:07.141153 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:07.141007    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:07.141153 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.141093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:07.692545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:07.692511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:07.692727 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.692671    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:07.692796 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.692746    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.692727273 +0000 UTC m=+18.134879558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:07.793736 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:07.793699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:07.793940 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:07.793748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:07.793940 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793870    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:07.793940 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793883    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:07.793940 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793917    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:07.793940 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793930    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:07.794188 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793961    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.793940538 +0000 UTC m=+18.236092813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:07.794188 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:07.793983    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.793972422 +0000 UTC m=+18.236124698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:08.142296 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:08.141763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:08.142296 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:08.141881    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:09.141382 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:09.141347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:09.141596 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:09.141486    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:09.141839 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:09.141347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:09.141999 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:09.141950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:10.140662 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:10.140616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:10.141167 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:10.140767    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:11.141086 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:11.141050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:11.141437 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:11.141050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:11.141437 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:11.141169    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:11.141437 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:11.141226    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:12.140404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:12.140369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:12.140595 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:12.140525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:13.140593 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:13.140557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:13.141019 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:13.140678    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:13.141019 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:13.140732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:13.141019 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:13.140843    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:14.141248 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:14.141217    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:14.141696 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:14.141351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:15.140474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:15.140431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:15.140708 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:15.140430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:15.140708 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.140580    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:15.140708 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.140656    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:15.753803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:15.753760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:15.754358 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.753948    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:15.754358 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.754027    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:31.754006209 +0000 UTC m=+34.196158484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:15.855042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:15.855006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:15.855042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:15.855049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:15.855232 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855155    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:15.855232 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855221    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:31.85520613 +0000 UTC m=+34.297358399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:15.855316 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855164    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:15.855316 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855263    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:15.855316 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855273    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:15.855316 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:15.855313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:31.855301754 +0000 UTC m=+34.297454023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:16.141170 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:16.141095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:16.141312 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:16.141230    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:17.141125 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:17.141082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:17.141492 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:17.141086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:17.141492 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:17.141217    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:17.141492 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:17.141276    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:18.141279 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:18.141246    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:18.141673 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:18.141349    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:19.140547 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:19.140516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:19.140735 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:19.140516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:19.140735 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:19.140623    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:19.140845 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:19.140736    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:20.141791 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.141760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:20.142187 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:20.141935    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:20.222169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.221748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k6bww" event={"ID":"0e0f3ac3-6af0-4e9f-aabe-7336108473b3","Type":"ContainerStarted","Data":"e56bb50e281eb52eb11ca1a87a4941f4a42acbc49f81800f0a15e209cb961203"}
Aug 04 18:01:20.230387 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.230338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal" event={"ID":"6b8da014694864829d0e8663a754d2a1","Type":"ContainerStarted","Data":"82766c48e0fef4d0814607548445366efe0a9c985f6e6d5a95861b15df200dd3"}
Aug 04 18:01:20.234801 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.234770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"7ce4ad34ae8c23fca38f7dee0acfca3ed95713331ce59869e81e7aa26f19757b"}
Aug 04 18:01:20.242356 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.242141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hs4r" event={"ID":"08e6a5a3-0206-4079-97c3-6c0fde69b891","Type":"ContainerStarted","Data":"81ce033b65832a2d3fedb4b9000f01b795548454a10afc1d7775c990129be89a"}
Aug 04 18:01:20.261640 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.261588    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k6bww" podStartSLOduration=2.480011136 podStartE2EDuration="22.26156804s" totalImagesPullingTime="19.781556904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:20.24312299 +0000 UTC m=+22.685275282" watchObservedRunningTime="2026-08-04 18:01:20.26156804 +0000 UTC m=+22.703720332"
Aug 04 18:01:20.262448 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.262407    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hs4r" podStartSLOduration=2.5975212 podStartE2EDuration="22.262394494s" totalImagesPullingTime="19.664873294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:20.261830714 +0000 UTC m=+22.703983000" watchObservedRunningTime="2026-08-04 18:01:20.262394494 +0000 UTC m=+22.704546786"
Aug 04 18:01:20.282396 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:20.281371    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-114.ec2.internal" podStartSLOduration=21.281351246 podStartE2EDuration="21.281351246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:20.280622875 +0000 UTC m=+22.722775181" watchObservedRunningTime="2026-08-04 18:01:20.281351246 +0000 UTC m=+22.723503538"
Aug 04 18:01:21.140935 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.140702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:21.141088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.140761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:21.141176 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:21.141145    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:21.141176 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:21.141027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:21.245671 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.245642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whsbv" event={"ID":"6468326b-f7ea-4a7f-8b90-672a176e226d","Type":"ContainerStarted","Data":"c97ccd4254fc860661f44f8da673276084824fac86dcd858f7d871e4ef18a157"}
Aug 04 18:01:21.247113 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.247091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxzh4" event={"ID":"5671e75c-a64c-4b9f-89bc-c5c7e6627d46","Type":"ContainerStarted","Data":"6e9cc595d214b950cbf7a2ea07514e9408253e83475d03627925f7f9313c7a2a"}
Aug 04 18:01:21.248422 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.248401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh" event={"ID":"03726312-770d-4c49-9b4c-d67465a83d00","Type":"ContainerStarted","Data":"c141a80fb52393f97eeb7646b44d94d5eb09cd375f35c8a82d6dadad5a70b5cd"}
Aug 04 18:01:21.249872 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.249851    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="52c59c4842570136859172c24ca179d05473cfbcd29c8a1d44fe4752f1bbcc48" exitCode=0
Aug 04 18:01:21.249973 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.249929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"52c59c4842570136859172c24ca179d05473cfbcd29c8a1d44fe4752f1bbcc48"}
Aug 04 18:01:21.251406 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.251385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5q72" event={"ID":"00d51c67-94ff-4aa2-8eb1-5de80210655c","Type":"ContainerStarted","Data":"c1577c79fde4e1199f2eb39412868611082423b5343f61a45a91b493317bf5af"}
Aug 04 18:01:21.254292 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.254265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"e9a8716d9c1e155207cca73c86a720bc935cb80317a8ffd3bc7e9c4af2d0c6f7"}
Aug 04 18:01:21.254368 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.254337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"03de7f4568d1b9cc4b4fd38cf2cd21621900c542cb44d6c79ff592e5628fc681"}
Aug 04 18:01:21.254417 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.254387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"658ec48388a79e054d6af26309410ed88d3394b78b0d8e5eda53b376de7c9260"}
Aug 04 18:01:21.254452 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.254435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"9cc4b72b805979a26dd4c56b09e3f2142dd4995a4d1e57560b6d5118fa372a19"}
Aug 04 18:01:21.254489 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.254480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"de6b15b9ccfeeb4aefa835fb47f0a70d7cc50e0f6a017df307c6f819d7a7d7da"}
Aug 04 18:01:21.255657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.255638    2580 generic.go:356] "Generic (PLEG): container finished" podID="6e9a61a639b79c945f24c1d4bade66ac" containerID="62df351d8eb4e6fb694fcd47d4126fcb530c384d0d5d935026fe64814cf5a7f8" exitCode=0
Aug 04 18:01:21.255761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.255728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal" event={"ID":"6e9a61a639b79c945f24c1d4bade66ac","Type":"ContainerDied","Data":"62df351d8eb4e6fb694fcd47d4126fcb530c384d0d5d935026fe64814cf5a7f8"}
Aug 04 18:01:21.264878 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.264831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-whsbv" podStartSLOduration=3.595706473 podStartE2EDuration="23.264814179s" totalImagesPullingTime="19.669107706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:21.264216798 +0000 UTC m=+23.706369090" watchObservedRunningTime="2026-08-04 18:01:21.264814179 +0000 UTC m=+23.706966470"
Aug 04 18:01:21.297415 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.297372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxzh4" podStartSLOduration=4.094170187 podStartE2EDuration="23.29735999s" totalImagesPullingTime="19.203189803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:21.296944395 +0000 UTC m=+23.739096687" watchObservedRunningTime="2026-08-04 18:01:21.29735999 +0000 UTC m=+23.739512314"
Aug 04 18:01:21.313839 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.313765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k5q72" podStartSLOduration=3.590857047 podStartE2EDuration="23.313754301s" totalImagesPullingTime="19.722897254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:21.313296462 +0000 UTC m=+23.755448752" watchObservedRunningTime="2026-08-04 18:01:21.313754301 +0000 UTC m=+23.755906592"
Aug 04 18:01:21.691674 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:21.691654    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 18:01:22.081167 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.081035    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T18:01:21.691670042Z","UUID":"c9634661-7189-48bb-8b47-fb78be45c36e","Handler":null,"Name":"","Endpoint":""}
Aug 04 18:01:22.082459 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.082433    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 18:01:22.082459 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.082465    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 18:01:22.140980 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.140959    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:22.141088 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:22.141062    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:22.259798 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.259767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal" event={"ID":"6e9a61a639b79c945f24c1d4bade66ac","Type":"ContainerStarted","Data":"f9df5f90e334a9e7064d4ad126a634e94e186d19c04bd1c1ef406b89e37a183a"}
Aug 04 18:01:22.261223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.261200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xp4v2" event={"ID":"faa59f9e-f492-4ac4-931c-f0e168bcc7e6","Type":"ContainerStarted","Data":"c47ef71bf7e828de512aeda3d2c9ebc3dd0c5325db5fea812e5f4996c4aef921"}
Aug 04 18:01:22.262785 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.262765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh" event={"ID":"03726312-770d-4c49-9b4c-d67465a83d00","Type":"ContainerStarted","Data":"c2d522bb4d442f7c363b485c406e5e1825c64c2bc2e952a5b782a5ad88f105cd"}
Aug 04 18:01:22.278620 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.278583    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-114.ec2.internal" podStartSLOduration=23.27857106 podStartE2EDuration="23.27857106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:22.278210475 +0000 UTC m=+24.720362897" watchObservedRunningTime="2026-08-04 18:01:22.27857106 +0000 UTC m=+24.720723352"
Aug 04 18:01:22.296813 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:22.296775    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xp4v2" podStartSLOduration=4.619570008 podStartE2EDuration="24.296759496s" totalImagesPullingTime="19.677189488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:22.295403085 +0000 UTC m=+24.737555402" watchObservedRunningTime="2026-08-04 18:01:22.296759496 +0000 UTC m=+24.738911781"
Aug 04 18:01:23.140927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.140908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:23.140927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.140917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:23.141056 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:23.141007    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:23.141170 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:23.141147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:23.267803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.267778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"dedc0284ef11eafcb62f482c365f540b967aef05ba52098f02a74dc3984c1be2"}
Aug 04 18:01:23.269719 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.269679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh" event={"ID":"03726312-770d-4c49-9b4c-d67465a83d00","Type":"ContainerStarted","Data":"105996a6ba2dfc8542486792521c43f199ca11e8638018fb3e7087ce163c8992"}
Aug 04 18:01:23.294618 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.294581    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7bhh" podStartSLOduration=3.029711814 podStartE2EDuration="25.294566167s" totalImagesPullingTime="22.264854353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:23.294215324 +0000 UTC m=+25.736367616" watchObservedRunningTime="2026-08-04 18:01:23.294566167 +0000 UTC m=+25.736718458"
Aug 04 18:01:23.767111 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.767079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:23.767798 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:23.767783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:24.141153 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:24.141064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:24.141306 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:24.141217    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:24.272610 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:24.272379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:24.273036 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:24.272754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxzh4"
Aug 04 18:01:24.698753 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:24.698727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whsbv_6468326b-f7ea-4a7f-8b90-672a176e226d/dns-node-resolver/0.log"
Aug 04 18:01:25.140899 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:25.140649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:25.141052 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:25.140660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:25.141052 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:25.141018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:25.141150 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:25.141080    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:25.277954 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:25.277853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" event={"ID":"e7f52a46-bea7-4d80-b589-d55ab394609b","Type":"ContainerStarted","Data":"9d3823ff3129fe6b83c193e5872cb715a77245ca763fc06734a271e057e0e248"}
Aug 04 18:01:25.310979 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:25.310933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8" podStartSLOduration=7.552966864 podStartE2EDuration="27.310917056s" totalImagesPullingTime="19.757950192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:25.310540627 +0000 UTC m=+27.752692929" watchObservedRunningTime="2026-08-04 18:01:25.310917056 +0000 UTC m=+27.753069344"
Aug 04 18:01:25.478934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:25.478908    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5q72_00d51c67-94ff-4aa2-8eb1-5de80210655c/node-ca/0.log"
Aug 04 18:01:26.140991 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.140956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:26.141171 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:26.141077    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:26.287910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.287337    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:26.287910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.287854    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:26.288531 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.287974    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:26.311013 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.310913    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:26.311630 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:26.311554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:27.107411 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.107192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fsgwg"]
Aug 04 18:01:27.107722 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.107544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:27.107722 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:27.107672    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:27.109446 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.109410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hbnsn"]
Aug 04 18:01:27.109588 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.109556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:27.109682 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:27.109660    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:27.110199 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.110175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wfgkp"]
Aug 04 18:01:27.110306 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:27.110293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:27.110422 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:27.110400    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:28.291773 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:28.291743    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="fc406790a3ae89ddb9cca3f22d9ca04a00f265cf7dfc98a4abd823661e100181" exitCode=0
Aug 04 18:01:28.292137 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:28.291823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"fc406790a3ae89ddb9cca3f22d9ca04a00f265cf7dfc98a4abd823661e100181"}
Aug 04 18:01:29.141198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:29.141160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:29.141362 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:29.141284    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:29.141362 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:29.141160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:29.141481 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:29.141160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:29.141481 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:29.141413    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:29.141545 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:29.141473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:29.296259 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:29.296224    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="6f97dd7241ed5a29aff044af7cd91a6b50314af8981642835cd14f91e16b1882" exitCode=0
Aug 04 18:01:29.296600 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:29.296270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"6f97dd7241ed5a29aff044af7cd91a6b50314af8981642835cd14f91e16b1882"}
Aug 04 18:01:30.300493 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:30.300464    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="c0695294cd23ebdfad483a68385fc8eb70a9ac55a1d065e0f2c0f4a9103f5b86" exitCode=0
Aug 04 18:01:30.300775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:30.300521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"c0695294cd23ebdfad483a68385fc8eb70a9ac55a1d065e0f2c0f4a9103f5b86"}
Aug 04 18:01:31.141007 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.140978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:31.141175 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.141090    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:31.141175 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.140982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:31.141309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.140979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:31.141309 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.141232    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:31.141389 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.141351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:31.776244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.776203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:31.776716 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.776381    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:31.776716 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.776466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret podName:ff9905c6-8e42-4f1c-ae89-030cc80dc053 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:03.776444793 +0000 UTC m=+66.218597067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret") pod "global-pull-secret-syncer-hbnsn" (UID: "ff9905c6-8e42-4f1c-ae89-030cc80dc053") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:01:31.876921 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.876879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:31.877088 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877048    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:01:31.877088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:31.877059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:31.877088 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877076    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:01:31.877088 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877089    2580 projected.go:196] Error preparing data for projected volume kube-api-access-gg28x for pod openshift-network-diagnostics/network-check-target-fsgwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:31.877285 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877154    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x podName:4dee438b-8cda-422f-9b89-4e1dada12df9 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:03.877136938 +0000 UTC m=+66.319289207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gg28x" (UniqueName: "kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x") pod "network-check-target-fsgwg" (UID: "4dee438b-8cda-422f-9b89-4e1dada12df9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:01:31.877285 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877171    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:31.877285 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:31.877221    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs podName:9a31bcc0-fe38-4c6a-bd83-a3131e3be390 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:03.877208376 +0000 UTC m=+66.319360645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs") pod "network-metrics-daemon-wfgkp" (UID: "9a31bcc0-fe38-4c6a-bd83-a3131e3be390") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:01:33.141293 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:33.141116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:33.141778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:33.141129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:33.141778 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:33.141367    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:33.141778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:33.141141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:33.141778 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:33.141481    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:33.141778 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:33.141556    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:35.140500 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:35.140466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:35.140500 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:35.140492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:35.140954 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:35.140582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:35.140954 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:35.140593    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:35.140954 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:35.140676    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:35.140954 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:35.140743    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:35.313365 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:35.313333    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="73f2b2c308d2cee10c2c42e7550cf7a6fb801810caaf06772f641a150dae04c6" exitCode=0
Aug 04 18:01:35.313516 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:35.313387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"73f2b2c308d2cee10c2c42e7550cf7a6fb801810caaf06772f641a150dae04c6"}
Aug 04 18:01:36.318849 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:36.318821    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ff1ef1e-d99e-4333-9d9c-243c0a09df12" containerID="3ef7c7e687ce5b266d6ad0c1ac91643d9ac1bb59b0190899dae2b6eb794a09cb" exitCode=0
Aug 04 18:01:36.319242 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:36.318867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerDied","Data":"3ef7c7e687ce5b266d6ad0c1ac91643d9ac1bb59b0190899dae2b6eb794a09cb"}
Aug 04 18:01:37.141215 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:37.141185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:37.141388 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:37.141233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:37.141388 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:37.141281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:37.141388 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:37.141299    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:37.141388 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:37.141352    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:37.141560 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:37.141447    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:37.324615 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:37.324581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" event={"ID":"7ff1ef1e-d99e-4333-9d9c-243c0a09df12","Type":"ContainerStarted","Data":"0e832a3b84c581cd60a90ccc5a59cc56e4dda865bcc6f02318684d1c7dabd239"}
Aug 04 18:01:37.350784 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:37.350664    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8dhw2" podStartSLOduration=7.401983606 podStartE2EDuration="39.350645837s" totalImagesPullingTime="31.948662231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:37.349618673 +0000 UTC m=+39.791770964" watchObservedRunningTime="2026-08-04 18:01:37.350645837 +0000 UTC m=+39.792798129"
Aug 04 18:01:39.140845 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:39.140811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:39.141408 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:39.140922    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:39.141408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:39.140951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:39.141408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:39.140965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:39.141408 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:39.140996    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:39.141408 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:39.141057    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:41.140492 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:41.140463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:41.140492 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:41.140477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:41.141048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:41.140554    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:41.141048 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:41.140573    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:41.141048 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:41.140695    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:41.141048 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:41.140819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:43.140977 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:43.140944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:43.141387 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:43.140944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:43.141387 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:43.141062    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:43.141387 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:43.140944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:43.141387 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:43.141121    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:43.141387 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:43.141185    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:45.141017 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:45.140987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:45.141017 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:45.141008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:45.141017 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:45.141021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:45.141464 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:45.141115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:45.141464 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:45.141147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:45.141464 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:45.141220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:47.140576 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:47.140547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:47.140953 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:47.140638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:47.140953 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:47.140644    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:47.140953 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:47.140645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:47.140953 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:47.140714    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:47.140953 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:47.140797    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:49.141341 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:49.141309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:49.141341 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:49.141330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:49.141873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:49.141309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:49.141873 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:49.141410    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:49.141873 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:49.141468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:49.141873 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:49.141544    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:51.141096 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:51.141059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:51.141524 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:51.141070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:51.141524 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:51.141174    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:51.141524 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:51.141165    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hbnsn" podUID="ff9905c6-8e42-4f1c-ae89-030cc80dc053"
Aug 04 18:01:51.141524 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:51.141248    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wfgkp" podUID="9a31bcc0-fe38-4c6a-bd83-a3131e3be390"
Aug 04 18:01:51.141524 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:01:51.141302    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fsgwg" podUID="4dee438b-8cda-422f-9b89-4e1dada12df9"
Aug 04 18:01:52.902153 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.902133    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-114.ec2.internal" event="NodeReady"
Aug 04 18:01:52.902520 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.902245    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 18:01:52.951690 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.951663    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p2gds"]
Aug 04 18:01:52.953706 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.953678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:52.954586 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.954563    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qb6kl"]
Aug 04 18:01:52.956056 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.956041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:52.958772 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.958752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwtj6\""
Aug 04 18:01:52.959106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.958982    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 18:01:52.959106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.959071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 18:01:52.960036 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.960019    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rwpcl\""
Aug 04 18:01:52.960134 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.960052    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 18:01:52.960187 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.960146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 18:01:52.960752 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.960330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 18:01:52.966792 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.966773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2gds"]
Aug 04 18:01:52.969441 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:52.969424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb6kl"]
Aug 04 18:01:53.021139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-tmp-dir\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.021260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-config-volume\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.021260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbe1a185-70e9-4745-9177-f2de5ebf0685-cert\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.021260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-metrics-tls\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.021411 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9lb\" (UniqueName: \"kubernetes.io/projected/fbe1a185-70e9-4745-9177-f2de5ebf0685-kube-api-access-7z9lb\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.021411 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.021345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx5r\" (UniqueName: \"kubernetes.io/projected/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-kube-api-access-8vx5r\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.052638 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.052618    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-56nzp"]
Aug 04 18:01:53.054520 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.054505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.057383 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.057365    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 18:01:53.057488 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.057396    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 18:01:53.057488 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.057456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 18:01:53.057586 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.057521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcf9m\""
Aug 04 18:01:53.057586 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.057569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 18:01:53.065906 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.065867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-56nzp"]
Aug 04 18:01:53.122413 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-metrics-tls\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.122516 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9lb\" (UniqueName: \"kubernetes.io/projected/fbe1a185-70e9-4745-9177-f2de5ebf0685-kube-api-access-7z9lb\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.122516 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx5r\" (UniqueName: \"kubernetes.io/projected/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-kube-api-access-8vx5r\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.122621 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/936654ff-ba14-4133-ba13-5567e5b4ed8f-crio-socket\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.122681 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-tmp-dir\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.122681 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/936654ff-ba14-4133-ba13-5567e5b4ed8f-data-volume\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.122777 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122708    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/936654ff-ba14-4133-ba13-5567e5b4ed8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.122777 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.122873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-config-volume\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.122873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbe1a185-70e9-4745-9177-f2de5ebf0685-cert\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.122873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbk8\" (UniqueName: \"kubernetes.io/projected/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-api-access-xbbk8\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.122873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.122862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-tmp-dir\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.123305 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.123285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-config-volume\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.126325 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.126302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-metrics-tls\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.126436 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.126417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbe1a185-70e9-4745-9177-f2de5ebf0685-cert\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.127855 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.127834    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:01:53.129929 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.129912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.132661 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.132645    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 18:01:53.133242 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.133227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 18:01:53.133516 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.133495    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 18:01:53.133722 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.133709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 18:01:53.134048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.134018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zhm5b\""
Aug 04 18:01:53.134143 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.134071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 18:01:53.134143 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.134077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 18:01:53.134143 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.134084    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 18:01:53.139700 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.139679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx5r\" (UniqueName: \"kubernetes.io/projected/513bc62b-9ef4-4752-b2f6-b642f7e9eae9-kube-api-access-8vx5r\") pod \"dns-default-p2gds\" (UID: \"513bc62b-9ef4-4752-b2f6-b642f7e9eae9\") " pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.139774 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.139682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9lb\" (UniqueName: \"kubernetes.io/projected/fbe1a185-70e9-4745-9177-f2de5ebf0685-kube-api-access-7z9lb\") pod \"ingress-canary-qb6kl\" (UID: \"fbe1a185-70e9-4745-9177-f2de5ebf0685\") " pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.140593 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.140579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:01:53.140677 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.140666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:01:53.140791 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.140777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:01:53.143709 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.143688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x566h\""
Aug 04 18:01:53.144076 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.144061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:01:53.144412 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.144392    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:01:53.144522 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.144499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:01:53.144722 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.144708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:01:53.144883 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.144871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbhlr\""
Aug 04 18:01:53.145083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.145069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:01:53.223752 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/936654ff-ba14-4133-ba13-5567e5b4ed8f-crio-socket\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.223854 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/936654ff-ba14-4133-ba13-5567e5b4ed8f-data-volume\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.223854 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.223854 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.223854 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxwk\" (UniqueName: \"kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.224042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/936654ff-ba14-4133-ba13-5567e5b4ed8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.224042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.224042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.224042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.223956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/936654ff-ba14-4133-ba13-5567e5b4ed8f-crio-socket\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.224042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.224020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.224254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.224065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbk8\" (UniqueName: \"kubernetes.io/projected/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-api-access-xbbk8\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.224254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.224075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/936654ff-ba14-4133-ba13-5567e5b4ed8f-data-volume\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.224254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.224121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.224442 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.224425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.225943 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.225921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/936654ff-ba14-4133-ba13-5567e5b4ed8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.233110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.233094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbk8\" (UniqueName: \"kubernetes.io/projected/936654ff-ba14-4133-ba13-5567e5b4ed8f-kube-api-access-xbbk8\") pod \"insights-runtime-extractor-56nzp\" (UID: \"936654ff-ba14-4133-ba13-5567e5b4ed8f\") " pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.264030 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.264011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:53.269373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.269358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb6kl"
Aug 04 18:01:53.325223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.325343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.325420 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxwk\" (UniqueName: \"kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.325479 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.325536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.325590 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.326010 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.325988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.326454 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.326429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.326559 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.326536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.328858 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.328834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.329337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.329313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.336462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.336288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxwk\" (UniqueName: \"kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk\") pod \"console-78559585b9-78wzs\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") " pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.362592 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.362571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-56nzp"
Aug 04 18:01:53.417036 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.416940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb6kl"]
Aug 04 18:01:53.437564 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.437453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2gds"]
Aug 04 18:01:53.440109 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:53.440076    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513bc62b_9ef4_4752_b2f6_b642f7e9eae9.slice/crio-18daa7d360768f8058cc5cce708105ddb1e3cad94fefd84fffa250c3197b1bb8 WatchSource:0}: Error finding container 18daa7d360768f8058cc5cce708105ddb1e3cad94fefd84fffa250c3197b1bb8: Status 404 returned error can't find the container with id 18daa7d360768f8058cc5cce708105ddb1e3cad94fefd84fffa250c3197b1bb8
Aug 04 18:01:53.448957 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.448864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:01:53.501430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.501404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-56nzp"]
Aug 04 18:01:53.506122 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:53.506095    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936654ff_ba14_4133_ba13_5567e5b4ed8f.slice/crio-c25b061baa157c5e9b4d2df1e48920ad5edebb39d2197bddd8179da4229923e3 WatchSource:0}: Error finding container c25b061baa157c5e9b4d2df1e48920ad5edebb39d2197bddd8179da4229923e3: Status 404 returned error can't find the container with id c25b061baa157c5e9b4d2df1e48920ad5edebb39d2197bddd8179da4229923e3
Aug 04 18:01:53.571371 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:53.571349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:01:53.574211 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:01:53.574188    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dde89c3_ffdd_4e3c_9385_c89e68fd1a0d.slice/crio-546689a65117b9fbad03cfc704114fcf037a25850f4e0d8bef9ade7aa10289d0 WatchSource:0}: Error finding container 546689a65117b9fbad03cfc704114fcf037a25850f4e0d8bef9ade7aa10289d0: Status 404 returned error can't find the container with id 546689a65117b9fbad03cfc704114fcf037a25850f4e0d8bef9ade7aa10289d0
Aug 04 18:01:54.362860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:54.362830    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78559585b9-78wzs" event={"ID":"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d","Type":"ContainerStarted","Data":"546689a65117b9fbad03cfc704114fcf037a25850f4e0d8bef9ade7aa10289d0"}
Aug 04 18:01:54.364374 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:54.364271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb6kl" event={"ID":"fbe1a185-70e9-4745-9177-f2de5ebf0685","Type":"ContainerStarted","Data":"e52ee205b0ffe64efca56d4618a8e4588325bd5c616b601c5084217ec88bc08f"}
Aug 04 18:01:54.365786 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:54.365758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2gds" event={"ID":"513bc62b-9ef4-4752-b2f6-b642f7e9eae9","Type":"ContainerStarted","Data":"18daa7d360768f8058cc5cce708105ddb1e3cad94fefd84fffa250c3197b1bb8"}
Aug 04 18:01:54.368747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:54.367665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56nzp" event={"ID":"936654ff-ba14-4133-ba13-5567e5b4ed8f","Type":"ContainerStarted","Data":"32241259c3fbd0b56586afab2b36479c4b1c1c5adddf8030ede53724aeb70214"}
Aug 04 18:01:54.368747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:54.367722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56nzp" event={"ID":"936654ff-ba14-4133-ba13-5567e5b4ed8f","Type":"ContainerStarted","Data":"c25b061baa157c5e9b4d2df1e48920ad5edebb39d2197bddd8179da4229923e3"}
Aug 04 18:01:57.378553 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.378518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78559585b9-78wzs" event={"ID":"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d","Type":"ContainerStarted","Data":"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"}
Aug 04 18:01:57.380045 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.380012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb6kl" event={"ID":"fbe1a185-70e9-4745-9177-f2de5ebf0685","Type":"ContainerStarted","Data":"5ddff4918e2a2ed6110d0fd30a0038688d489a3f13171753cdcff4080b695ea8"}
Aug 04 18:01:57.381649 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.381628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2gds" event={"ID":"513bc62b-9ef4-4752-b2f6-b642f7e9eae9","Type":"ContainerStarted","Data":"8676d46b211bddb737f63d653a0515e980a2fcdaecbd443b6eb6d2808e21d0cd"}
Aug 04 18:01:57.381742 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.381664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2gds" event={"ID":"513bc62b-9ef4-4752-b2f6-b642f7e9eae9","Type":"ContainerStarted","Data":"040fc371c7102d8475304d72658c4b8c9d97162c9fb835fbf3fbf8bb5db49c19"}
Aug 04 18:01:57.381742 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.381686    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p2gds"
Aug 04 18:01:57.383245 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.383223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56nzp" event={"ID":"936654ff-ba14-4133-ba13-5567e5b4ed8f","Type":"ContainerStarted","Data":"3adbbc6ac2744237adaee5c166d08c26df898a4e81b1fd88881b78deb881d33b"}
Aug 04 18:01:57.417481 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.417428    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p2gds" podStartSLOduration=1.919067152 podStartE2EDuration="5.417409697s" totalImagesPullingTime="3.498342545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:57.416599022 +0000 UTC m=+59.858751314" watchObservedRunningTime="2026-08-04 18:01:57.417409697 +0000 UTC m=+59.859561990"
Aug 04 18:01:57.417745 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.417722    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78559585b9-78wzs" podStartSLOduration=1.043381085 podStartE2EDuration="4.41771591s" totalImagesPullingTime="3.374334825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:57.397909749 +0000 UTC m=+59.840062043" watchObservedRunningTime="2026-08-04 18:01:57.41771591 +0000 UTC m=+59.859868179"
Aug 04 18:01:57.437542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:57.437478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qb6kl" podStartSLOduration=1.912781981 podStartE2EDuration="5.43746032s" totalImagesPullingTime="3.524678339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:57.437331223 +0000 UTC m=+59.879483515" watchObservedRunningTime="2026-08-04 18:01:57.43746032 +0000 UTC m=+59.879612612"
Aug 04 18:01:58.308737 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:58.308709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-czvw8"
Aug 04 18:01:59.390714 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:59.390678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-56nzp" event={"ID":"936654ff-ba14-4133-ba13-5567e5b4ed8f","Type":"ContainerStarted","Data":"f5e6509904a98ad1b87d7d158d3b301c5787ab477d49c0b4d1713808d8cbcb60"}
Aug 04 18:01:59.410440 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:01:59.410398    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-56nzp" podStartSLOduration=0.973274006 podStartE2EDuration="6.410384765s" totalImagesPullingTime="5.437110759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:01:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:59.409854238 +0000 UTC m=+61.852006528" watchObservedRunningTime="2026-08-04 18:01:59.410384765 +0000 UTC m=+61.852537056"
Aug 04 18:02:00.314806 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.314779    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"]
Aug 04 18:02:00.316883 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.316868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.321063 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321045    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 18:02:00.321063 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 18:02:00.321063 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 18:02:00.321319 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321303    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 18:02:00.321368 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321327    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 18:02:00.321404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.321389    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-275dj\""
Aug 04 18:02:00.326833 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.326815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"]
Aug 04 18:02:00.383499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.383475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.383598 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.383532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10994d0c-26d7-4d05-8f7c-38e19751a2d5-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.383640 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.383605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.383683 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.383659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gxj\" (UniqueName: \"kubernetes.io/projected/10994d0c-26d7-4d05-8f7c-38e19751a2d5-kube-api-access-d9gxj\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.483969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.483933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10994d0c-26d7-4d05-8f7c-38e19751a2d5-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.484466 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.484006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.484466 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.484074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gxj\" (UniqueName: \"kubernetes.io/projected/10994d0c-26d7-4d05-8f7c-38e19751a2d5-kube-api-access-d9gxj\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.484466 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.484109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.484466 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:00.484217    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 18:02:00.484466 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:00.484288    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls podName:10994d0c-26d7-4d05-8f7c-38e19751a2d5 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:00.984268865 +0000 UTC m=+63.426421133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-q2gxw" (UID: "10994d0c-26d7-4d05-8f7c-38e19751a2d5") : secret "prometheus-operator-tls" not found
Aug 04 18:02:00.484742 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.484645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10994d0c-26d7-4d05-8f7c-38e19751a2d5-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.486415 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.486392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.495978 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.495955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gxj\" (UniqueName: \"kubernetes.io/projected/10994d0c-26d7-4d05-8f7c-38e19751a2d5-kube-api-access-d9gxj\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.988698 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.988659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:00.991138 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:00.991107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/10994d0c-26d7-4d05-8f7c-38e19751a2d5-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-q2gxw\" (UID: \"10994d0c-26d7-4d05-8f7c-38e19751a2d5\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:01.225147 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.225114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"
Aug 04 18:02:01.344688 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.344666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-q2gxw"]
Aug 04 18:02:01.346953 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:01.346927    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10994d0c_26d7_4d05_8f7c_38e19751a2d5.slice/crio-8de1753e57a05dd5045658dca38c9dbce6f68ed4b0cd4ba21399f47c2b73ff49 WatchSource:0}: Error finding container 8de1753e57a05dd5045658dca38c9dbce6f68ed4b0cd4ba21399f47c2b73ff49: Status 404 returned error can't find the container with id 8de1753e57a05dd5045658dca38c9dbce6f68ed4b0cd4ba21399f47c2b73ff49
Aug 04 18:02:01.398139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.398113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw" event={"ID":"10994d0c-26d7-4d05-8f7c-38e19751a2d5","Type":"ContainerStarted","Data":"8de1753e57a05dd5045658dca38c9dbce6f68ed4b0cd4ba21399f47c2b73ff49"}
Aug 04 18:02:01.703385 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.703359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:01.706051 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.706035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.716456 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.716437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 18:02:01.724691 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.724661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:01.794697 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794796 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794796 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794796 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcts\" (UniqueName: \"kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794922 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794922 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.794989 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.794926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895371 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcts\" (UniqueName: \"kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.895533 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.895524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.896252 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.896201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.896365 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.896305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.896500 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.896473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.896779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.896757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.898178 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.898157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.898368 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.898345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:01.905701 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:01.905682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcts\" (UniqueName: \"kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts\") pod \"console-5b4f68cb5b-bvtsg\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") " pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:02.015283 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:02.015022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:02.153053 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:02.153023    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:02.159118 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:02.159088    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee81d99_ca81_4f7d_9902_079d188c62a6.slice/crio-e4a9e0fa8eddec24c231a3dbaa5ccde0e67f0d40ab31b4f5c767eea6c27808bb WatchSource:0}: Error finding container e4a9e0fa8eddec24c231a3dbaa5ccde0e67f0d40ab31b4f5c767eea6c27808bb: Status 404 returned error can't find the container with id e4a9e0fa8eddec24c231a3dbaa5ccde0e67f0d40ab31b4f5c767eea6c27808bb
Aug 04 18:02:02.405751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:02.405718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f68cb5b-bvtsg" event={"ID":"4ee81d99-ca81-4f7d-9902-079d188c62a6","Type":"ContainerStarted","Data":"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"}
Aug 04 18:02:02.405960 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:02.405768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f68cb5b-bvtsg" event={"ID":"4ee81d99-ca81-4f7d-9902-079d188c62a6","Type":"ContainerStarted","Data":"e4a9e0fa8eddec24c231a3dbaa5ccde0e67f0d40ab31b4f5c767eea6c27808bb"}
Aug 04 18:02:02.430073 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:02.430019    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4f68cb5b-bvtsg" podStartSLOduration=1.430004393 podStartE2EDuration="1.430004393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:02.429076207 +0000 UTC m=+64.871228498" watchObservedRunningTime="2026-08-04 18:02:02.430004393 +0000 UTC m=+64.872156684"
Aug 04 18:02:03.410486 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.410452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw" event={"ID":"10994d0c-26d7-4d05-8f7c-38e19751a2d5","Type":"ContainerStarted","Data":"803f63e90f3e9a9531c2ab26d81658643adc6eeff704f594b2fb2c7113cdbd4e"}
Aug 04 18:02:03.410905 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.410505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw" event={"ID":"10994d0c-26d7-4d05-8f7c-38e19751a2d5","Type":"ContainerStarted","Data":"3c44ea3271e99111930bcdd523819e77a103b6e7dff078f41aed4844f20bc2cd"}
Aug 04 18:02:03.431115 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.431066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-q2gxw" podStartSLOduration=2.265364861 podStartE2EDuration="3.431048454s" totalImagesPullingTime="1.165683593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:03.430754555 +0000 UTC m=+65.872906847" watchObservedRunningTime="2026-08-04 18:02:03.431048454 +0000 UTC m=+65.873200746"
Aug 04 18:02:03.449875 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.449850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:03.449992 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.449911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:03.454516 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.454496    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:03.811051 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.810969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:02:03.813933 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.813915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:02:03.823379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.823361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff9905c6-8e42-4f1c-ae89-030cc80dc053-original-pull-secret\") pod \"global-pull-secret-syncer-hbnsn\" (UID: \"ff9905c6-8e42-4f1c-ae89-030cc80dc053\") " pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:02:03.911737 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.911709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:02:03.911870 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.911744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:02:03.914987 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.914971    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:02:03.915034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.914974    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:02:03.924499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.924473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a31bcc0-fe38-4c6a-bd83-a3131e3be390-metrics-certs\") pod \"network-metrics-daemon-wfgkp\" (UID: \"9a31bcc0-fe38-4c6a-bd83-a3131e3be390\") " pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:02:03.925025 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.925009    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:02:03.935255 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.935234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg28x\" (UniqueName: \"kubernetes.io/projected/4dee438b-8cda-422f-9b89-4e1dada12df9-kube-api-access-gg28x\") pod \"network-check-target-fsgwg\" (UID: \"4dee438b-8cda-422f-9b89-4e1dada12df9\") " pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:02:03.958992 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.958974    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbhlr\""
Aug 04 18:02:03.961360 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.961348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hbnsn"
Aug 04 18:02:03.966348 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.966335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wfgkp"
Aug 04 18:02:03.969132 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.969112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x566h\""
Aug 04 18:02:03.977490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:03.977460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:02:04.097171 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.097145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hbnsn"]
Aug 04 18:02:04.099863 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:04.099831    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9905c6_8e42_4f1c_ae89_030cc80dc053.slice/crio-5ea03b20cae474ae6ff6f544058dfeab23dbfcfc1a8f35f478f6c6472f11bcc8 WatchSource:0}: Error finding container 5ea03b20cae474ae6ff6f544058dfeab23dbfcfc1a8f35f478f6c6472f11bcc8: Status 404 returned error can't find the container with id 5ea03b20cae474ae6ff6f544058dfeab23dbfcfc1a8f35f478f6c6472f11bcc8
Aug 04 18:02:04.117809 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.117787    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wfgkp"]
Aug 04 18:02:04.120623 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:04.120584    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a31bcc0_fe38_4c6a_bd83_a3131e3be390.slice/crio-eb4b32aa93198ff9c08c857cf84c992814ee17760adcb41d5d7978bf6c80b1fb WatchSource:0}: Error finding container eb4b32aa93198ff9c08c857cf84c992814ee17760adcb41d5d7978bf6c80b1fb: Status 404 returned error can't find the container with id eb4b32aa93198ff9c08c857cf84c992814ee17760adcb41d5d7978bf6c80b1fb
Aug 04 18:02:04.136592 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.136562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fsgwg"]
Aug 04 18:02:04.140073 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:04.140040    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dee438b_8cda_422f_9b89_4e1dada12df9.slice/crio-d90a394cc19044493f909bd62d7d4c3c2018d7fafbacb51db88a864480745af8 WatchSource:0}: Error finding container d90a394cc19044493f909bd62d7d4c3c2018d7fafbacb51db88a864480745af8: Status 404 returned error can't find the container with id d90a394cc19044493f909bd62d7d4c3c2018d7fafbacb51db88a864480745af8
Aug 04 18:02:04.415197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.415165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfgkp" event={"ID":"9a31bcc0-fe38-4c6a-bd83-a3131e3be390","Type":"ContainerStarted","Data":"eb4b32aa93198ff9c08c857cf84c992814ee17760adcb41d5d7978bf6c80b1fb"}
Aug 04 18:02:04.416336 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.416312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hbnsn" event={"ID":"ff9905c6-8e42-4f1c-ae89-030cc80dc053","Type":"ContainerStarted","Data":"5ea03b20cae474ae6ff6f544058dfeab23dbfcfc1a8f35f478f6c6472f11bcc8"}
Aug 04 18:02:04.417338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.417316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fsgwg" event={"ID":"4dee438b-8cda-422f-9b89-4e1dada12df9","Type":"ContainerStarted","Data":"d90a394cc19044493f909bd62d7d4c3c2018d7fafbacb51db88a864480745af8"}
Aug 04 18:02:04.421134 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:04.421117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:05.657571 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.656271    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"]
Aug 04 18:02:05.678716 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.678312    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"]
Aug 04 18:02:05.678716 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.678630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.681805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.681516    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 18:02:05.681805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.681533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-scd2c\""
Aug 04 18:02:05.681805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.681755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 18:02:05.697379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.696226    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8zds"]
Aug 04 18:02:05.697379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.696499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.699592 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.699427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 18:02:05.700062 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.699803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 18:02:05.700062 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.699819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g65ld\""
Aug 04 18:02:05.700062 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.699819    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 18:02:05.714346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.714323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"]
Aug 04 18:02:05.714471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.714374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"]
Aug 04 18:02:05.714529 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.714482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.717689 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.717650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 18:02:05.717689 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.717661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zlmsf\""
Aug 04 18:02:05.717964 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.717922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 18:02:05.718316 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.718111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 18:02:05.727234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.727212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.727342 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.727255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e947580c-4029-474a-9838-9004b60758fa-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.727342 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.727289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7vf\" (UniqueName: \"kubernetes.io/projected/e947580c-4029-474a-9838-9004b60758fa-kube-api-access-dw7vf\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.727454 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.727359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.828113 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-metrics-client-ca\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-wtmp\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.828304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-root\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-textfile\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828540 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.828540 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-tls\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.828540 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.828540 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.828717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zbn5\" (UniqueName: \"kubernetes.io/projected/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-api-access-6zbn5\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.828717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e947580c-4029-474a-9838-9004b60758fa-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.828717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7vf\" (UniqueName: \"kubernetes.io/projected/e947580c-4029-474a-9838-9004b60758fa-kube-api-access-dw7vf\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.828717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.828717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-sys\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjl8\" (UniqueName: \"kubernetes.io/projected/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-kube-api-access-6qjl8\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.828823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08832903-a80d-4882-88ab-0ca30ed8c8bc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:05.828903    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 04 18:02:05.829047 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:05.828984    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls podName:e947580c-4029-474a-9838-9004b60758fa nodeName:}" failed. No retries permitted until 2026-08-04 18:02:06.328962579 +0000 UTC m=+68.771114854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-mh9mt" (UID: "e947580c-4029-474a-9838-9004b60758fa") : secret "openshift-state-metrics-tls" not found
Aug 04 18:02:05.829419 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.829392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e947580c-4029-474a-9838-9004b60758fa-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.831509 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.831486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.839653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.839610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7vf\" (UniqueName: \"kubernetes.io/projected/e947580c-4029-474a-9838-9004b60758fa-kube-api-access-dw7vf\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:05.930182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjl8\" (UniqueName: \"kubernetes.io/projected/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-kube-api-access-6qjl8\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08832903-a80d-4882-88ab-0ca30ed8c8bc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-metrics-client-ca\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-wtmp\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-root\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-textfile\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-tls\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930832 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zbn5\" (UniqueName: \"kubernetes.io/projected/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-api-access-6zbn5\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930906 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/08832903-a80d-4882-88ab-0ca30ed8c8bc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.930968 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.930945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-root\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-wtmp\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-metrics-client-ca\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931323 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.931323 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-sys\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931428 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931428 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.931428 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-sys\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.931776 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.931855 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.931815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.932084 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.932025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-textfile\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.934105 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.934085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.934538 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.934481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-node-exporter-tls\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:05.935368 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.935327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.935826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.935779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.942898 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.942858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zbn5\" (UniqueName: \"kubernetes.io/projected/08832903-a80d-4882-88ab-0ca30ed8c8bc-kube-api-access-6zbn5\") pod \"kube-state-metrics-6bd9664c4-pv4p7\" (UID: \"08832903-a80d-4882-88ab-0ca30ed8c8bc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:05.944409 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:05.944383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjl8\" (UniqueName: \"kubernetes.io/projected/52b22dc0-8f21-4a4a-9e0a-32ee731db4a0-kube-api-access-6qjl8\") pod \"node-exporter-s8zds\" (UID: \"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0\") " pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:06.009013 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.008759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"
Aug 04 18:02:06.025926 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.025877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8zds"
Aug 04 18:02:06.066544 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:06.066511    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b22dc0_8f21_4a4a_9e0a_32ee731db4a0.slice/crio-605c7e6ef0946dd84fbb6ca7eef80849aac8963e832a4b86695203b58d76c3e0 WatchSource:0}: Error finding container 605c7e6ef0946dd84fbb6ca7eef80849aac8963e832a4b86695203b58d76c3e0: Status 404 returned error can't find the container with id 605c7e6ef0946dd84fbb6ca7eef80849aac8963e832a4b86695203b58d76c3e0
Aug 04 18:02:06.194429 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.194318    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7"]
Aug 04 18:02:06.199426 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:06.199394    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08832903_a80d_4882_88ab_0ca30ed8c8bc.slice/crio-4f5a70e48a4156859ddefb65cee9291591f9f64055c9c0b37166955d09d9dc6c WatchSource:0}: Error finding container 4f5a70e48a4156859ddefb65cee9291591f9f64055c9c0b37166955d09d9dc6c: Status 404 returned error can't find the container with id 4f5a70e48a4156859ddefb65cee9291591f9f64055c9c0b37166955d09d9dc6c
Aug 04 18:02:06.335239 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.335205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:06.337801 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.337777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e947580c-4029-474a-9838-9004b60758fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mh9mt\" (UID: \"e947580c-4029-474a-9838-9004b60758fa\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:06.426528 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.426431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7" event={"ID":"08832903-a80d-4882-88ab-0ca30ed8c8bc","Type":"ContainerStarted","Data":"4f5a70e48a4156859ddefb65cee9291591f9f64055c9c0b37166955d09d9dc6c"}
Aug 04 18:02:06.427939 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.427907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8zds" event={"ID":"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0","Type":"ContainerStarted","Data":"605c7e6ef0946dd84fbb6ca7eef80849aac8963e832a4b86695203b58d76c3e0"}
Aug 04 18:02:06.592371 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.592285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"
Aug 04 18:02:06.753392 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.753345    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:02:06.756101 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.756077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.760853 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:02:06.761059 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760909    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:02:06.761059 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:02:06.761059 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:02:06.761059 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:02:06.761334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.761034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:02:06.761334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.760834    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:02:06.761334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.761112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:02:06.761334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.761221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ksrgz\""
Aug 04 18:02:06.761334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.761325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:02:06.772092 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.772069    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:02:06.840402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840572 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840572 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840698 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztnkv\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840750 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840933 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.840933 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.841022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.840954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.841022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.841001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.841108 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.841048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942121 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942311 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942311 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztnkv\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942311 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942453 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942453 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942453 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.942646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.942973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.943011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.943860 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.943197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.944745 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.944697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.945832 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.945809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.946335 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.946309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.946799 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.946501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.946799 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.946529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.946937 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.946803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.947255 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.947230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.947490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.947446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.947905 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.947860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.948313 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.948284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:06.951427 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:06.951402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztnkv\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv\") pod \"alertmanager-main-0\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:07.069727 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.069694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:02:07.388339 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.388303    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p2gds"
Aug 04 18:02:07.647050 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.646967    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"]
Aug 04 18:02:07.649978 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.649946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.652845 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.652813    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 18:02:07.653139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.653086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 18:02:07.653241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.653189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 18:02:07.653241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.653199    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8p2mk\""
Aug 04 18:02:07.653328 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.653235    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4pavb20ul4dci\""
Aug 04 18:02:07.654081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.654062    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 18:02:07.654315 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.654272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 18:02:07.664294 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.664273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"]
Aug 04 18:02:07.750879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.750843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-grpc-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.750902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.750988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.751042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.751139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.751170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.751197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5ebdca-1a2a-4210-857d-8d3613482297-metrics-client-ca\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.751338 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.751302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql77\" (UniqueName: \"kubernetes.io/projected/9c5ebdca-1a2a-4210-857d-8d3613482297-kube-api-access-dql77\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852027 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.851955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql77\" (UniqueName: \"kubernetes.io/projected/9c5ebdca-1a2a-4210-857d-8d3613482297-kube-api-access-dql77\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852027 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-grpc-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.852539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.852340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5ebdca-1a2a-4210-857d-8d3613482297-metrics-client-ca\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.853175 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.853128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c5ebdca-1a2a-4210-857d-8d3613482297-metrics-client-ca\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.855085 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.855059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.855287 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.855261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.855411 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.855376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.855864 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.855845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.856049 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.856028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-grpc-tls\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.856379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.856363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9c5ebdca-1a2a-4210-857d-8d3613482297-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.860870 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.860849    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql77\" (UniqueName: \"kubernetes.io/projected/9c5ebdca-1a2a-4210-857d-8d3613482297-kube-api-access-dql77\") pod \"thanos-querier-7c4bb6d66d-kqhp9\" (UID: \"9c5ebdca-1a2a-4210-857d-8d3613482297\") " pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:07.962542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:07.962452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:08.982694 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:08.982670    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:02:09.099427 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:09.099341    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b2f691_9c98_4afe_918f_8db80a4e20e5.slice/crio-537b8a9085210e5bba2f677cfa4e37171d699340b371189b3df4955576ff27f9 WatchSource:0}: Error finding container 537b8a9085210e5bba2f677cfa4e37171d699340b371189b3df4955576ff27f9: Status 404 returned error can't find the container with id 537b8a9085210e5bba2f677cfa4e37171d699340b371189b3df4955576ff27f9
Aug 04 18:02:09.441767 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:09.441728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"537b8a9085210e5bba2f677cfa4e37171d699340b371189b3df4955576ff27f9"}
Aug 04 18:02:09.869646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:09.869612    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"]
Aug 04 18:02:09.872270 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:09.872151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt"]
Aug 04 18:02:09.883086 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:09.883060    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode947580c_4029_474a_9838_9004b60758fa.slice/crio-cabc16b8e95193c0ebe1b38d5b610958b785524eb5c1d22404a96ea772304c01 WatchSource:0}: Error finding container cabc16b8e95193c0ebe1b38d5b610958b785524eb5c1d22404a96ea772304c01: Status 404 returned error can't find the container with id cabc16b8e95193c0ebe1b38d5b610958b785524eb5c1d22404a96ea772304c01
Aug 04 18:02:09.994602 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:09.993573    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fdb88df97-pwlcr"]
Aug 04 18:02:09.999308 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:09.998079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.002846 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.002434    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:02:10.002846 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.002521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 04 18:02:10.002846 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.002848    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f8ttf\""
Aug 04 18:02:10.003139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.002852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 04 18:02:10.003139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.002863    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 04 18:02:10.003139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.003080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a4uj4afpgmhi8\""
Aug 04 18:02:10.022018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.020167    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fdb88df97-pwlcr"]
Aug 04 18:02:10.075101 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.074804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-client-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-tls\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/36150acf-7745-40b7-af5b-bbfc6f484257-audit-log\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-metrics-server-audit-profiles\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.075584 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.075480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdb9\" (UniqueName: \"kubernetes.io/projected/36150acf-7745-40b7-af5b-bbfc6f484257-kube-api-access-qxdb9\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.175855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-tls\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.175925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.175944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/36150acf-7745-40b7-af5b-bbfc6f484257-audit-log\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.175961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-metrics-server-audit-profiles\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.175978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdb9\" (UniqueName: \"kubernetes.io/projected/36150acf-7745-40b7-af5b-bbfc6f484257-kube-api-access-qxdb9\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.176008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-client-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176309 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.176025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176829 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.176756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.176829 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.176797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/36150acf-7745-40b7-af5b-bbfc6f484257-audit-log\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.177762 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.177682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/36150acf-7745-40b7-af5b-bbfc6f484257-metrics-server-audit-profiles\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.180158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.180108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-client-certs\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.180746 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.180705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-secret-metrics-server-tls\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.183979 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.183185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36150acf-7745-40b7-af5b-bbfc6f484257-client-ca-bundle\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.197407 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.197373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdb9\" (UniqueName: \"kubernetes.io/projected/36150acf-7745-40b7-af5b-bbfc6f484257-kube-api-access-qxdb9\") pod \"metrics-server-6fdb88df97-pwlcr\" (UID: \"36150acf-7745-40b7-af5b-bbfc6f484257\") " pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.351534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.351447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:10.448549 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.448504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7" event={"ID":"08832903-a80d-4882-88ab-0ca30ed8c8bc","Type":"ContainerStarted","Data":"994be3700cfab73d5a493deaf3ed89d2e9992a10d6995a9446e6276102c46526"}
Aug 04 18:02:10.448751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.448610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7" event={"ID":"08832903-a80d-4882-88ab-0ca30ed8c8bc","Type":"ContainerStarted","Data":"7194ad78f2fb0a6a03f02a7945f98e5d9d6e47fe33141c31333a037401b0ea44"}
Aug 04 18:02:10.448751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.448650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7" event={"ID":"08832903-a80d-4882-88ab-0ca30ed8c8bc","Type":"ContainerStarted","Data":"b31af4931d15799e1da5c4ca8efb90718a483eb171d3ac0a554b76b40ccae529"}
Aug 04 18:02:10.451037 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.451002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt" event={"ID":"e947580c-4029-474a-9838-9004b60758fa","Type":"ContainerStarted","Data":"aec6d725df19c88af7ddc53008698bcd52cc97537c493a773f4a747a8d06f41c"}
Aug 04 18:02:10.451185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.451075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt" event={"ID":"e947580c-4029-474a-9838-9004b60758fa","Type":"ContainerStarted","Data":"fe605dbfc29f4ef271b7997202916a4e3798caed2f60c0170fff75f7fc1b56e8"}
Aug 04 18:02:10.451185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.451105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt" event={"ID":"e947580c-4029-474a-9838-9004b60758fa","Type":"ContainerStarted","Data":"cabc16b8e95193c0ebe1b38d5b610958b785524eb5c1d22404a96ea772304c01"}
Aug 04 18:02:10.452910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.452864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fsgwg" event={"ID":"4dee438b-8cda-422f-9b89-4e1dada12df9","Type":"ContainerStarted","Data":"7973be5ab6548115d5b0de5cbdd10fe3727cb8c0a4ed093827961e080e20d269"}
Aug 04 18:02:10.455723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.455566    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:02:10.455723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.455602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfgkp" event={"ID":"9a31bcc0-fe38-4c6a-bd83-a3131e3be390","Type":"ContainerStarted","Data":"621235d0b8bf0788e244233915dfba4b838882e51e83f4dc01ab486c9dc5f0bb"}
Aug 04 18:02:10.455723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.455631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wfgkp" event={"ID":"9a31bcc0-fe38-4c6a-bd83-a3131e3be390","Type":"ContainerStarted","Data":"2f0b16919e924b9e0e02561d5652dc6db7223c5a1a500c9072107f9378f65526"}
Aug 04 18:02:10.456747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.456710    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"]
Aug 04 18:02:10.459724 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.459694    2580 generic.go:356] "Generic (PLEG): container finished" podID="52b22dc0-8f21-4a4a-9e0a-32ee731db4a0" containerID="0e338699e505869fb8ae8933d9000219efe61f0425a2dff6ca1e2fe1337d2941" exitCode=0
Aug 04 18:02:10.460114 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.460096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hbnsn" event={"ID":"ff9905c6-8e42-4f1c-ae89-030cc80dc053","Type":"ContainerStarted","Data":"306950354bdf7342ce59509d7201b3719e97bae706da43f142e8f29ccb757da6"}
Aug 04 18:02:10.460211 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.460128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8zds" event={"ID":"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0","Type":"ContainerDied","Data":"0e338699e505869fb8ae8933d9000219efe61f0425a2dff6ca1e2fe1337d2941"}
Aug 04 18:02:10.460211 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.460207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.461182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.461160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"5a38b6edc80fbd2a34874cc8ff04729f9e8388cc328838d9f5c0457b003aedbd"}
Aug 04 18:02:10.463267 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.463249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lprrq\""
Aug 04 18:02:10.463404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.463292    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 18:02:10.469835 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.469810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"]
Aug 04 18:02:10.476428 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.474722    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-pv4p7" podStartSLOduration=1.946316605 podStartE2EDuration="5.474704077s" totalImagesPullingTime="3.528387472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:10.474592425 +0000 UTC m=+72.916744717" watchObservedRunningTime="2026-08-04 18:02:10.474704077 +0000 UTC m=+72.916856370"
Aug 04 18:02:10.498505 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.498452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hbnsn" podStartSLOduration=66.935120362 podStartE2EDuration="1m12.498435127s" totalImagesPullingTime="5.563314765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:10.497135476 +0000 UTC m=+72.939287825" watchObservedRunningTime="2026-08-04 18:02:10.498435127 +0000 UTC m=+72.940587418"
Aug 04 18:02:10.518428 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.518361    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wfgkp" podStartSLOduration=66.972941849 podStartE2EDuration="1m12.518339633s" totalImagesPullingTime="5.545397784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:10.516883749 +0000 UTC m=+72.959036041" watchObservedRunningTime="2026-08-04 18:02:10.518339633 +0000 UTC m=+72.960491924"
Aug 04 18:02:10.580240 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.579962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad28d0e-6e35-4e60-8c86-43402c56a845-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.580240 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.580179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6pp\" (UniqueName: \"kubernetes.io/projected/0ad28d0e-6e35-4e60-8c86-43402c56a845-kube-api-access-mt6pp\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.587331 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.587280    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fsgwg" podStartSLOduration=67.41338748 podStartE2EDuration="1m12.587259112s" totalImagesPullingTime="5.173871632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:10.586510385 +0000 UTC m=+73.028662676" watchObservedRunningTime="2026-08-04 18:02:10.587259112 +0000 UTC m=+73.029411406"
Aug 04 18:02:10.684744 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.681518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad28d0e-6e35-4e60-8c86-43402c56a845-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.684744 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.681600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6pp\" (UniqueName: \"kubernetes.io/projected/0ad28d0e-6e35-4e60-8c86-43402c56a845-kube-api-access-mt6pp\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.686763 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.686697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ad28d0e-6e35-4e60-8c86-43402c56a845-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.693198 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.693140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6pp\" (UniqueName: \"kubernetes.io/projected/0ad28d0e-6e35-4e60-8c86-43402c56a845-kube-api-access-mt6pp\") pod \"monitoring-plugin-6dffbbd67-kr5qn\" (UID: \"0ad28d0e-6e35-4e60-8c86-43402c56a845\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.724155 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.723734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fdb88df97-pwlcr"]
Aug 04 18:02:10.731766 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:10.731717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36150acf_7745_40b7_af5b_bbfc6f484257.slice/crio-7ae361e26819025e5a2fe707a300613df629b0bae677cc8bb044e6010ab76775 WatchSource:0}: Error finding container 7ae361e26819025e5a2fe707a300613df629b0bae677cc8bb044e6010ab76775: Status 404 returned error can't find the container with id 7ae361e26819025e5a2fe707a300613df629b0bae677cc8bb044e6010ab76775
Aug 04 18:02:10.777348 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.777304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:10.897343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.896949    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb88f68f5-4q77c"]
Aug 04 18:02:10.904714 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.904148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.907712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.907082    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 18:02:10.907712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.907321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 18:02:10.907712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.907522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wwk2f\""
Aug 04 18:02:10.908524 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.908387    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 18:02:10.908524 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.908407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 18:02:10.908673 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.908646    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 18:02:10.919123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.919095    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 18:02:10.920371 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.920340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb88f68f5-4q77c"]
Aug 04 18:02:10.942652 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.942585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"]
Aug 04 18:02:10.947475 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:10.947424    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad28d0e_6e35_4e60_8c86_43402c56a845.slice/crio-0eee8d0c50e37ef832e3d7e21c383042639304b97f9c0f4e71be085e30f75d0e WatchSource:0}: Error finding container 0eee8d0c50e37ef832e3d7e21c383042639304b97f9c0f4e71be085e30f75d0e: Status 404 returned error can't find the container with id 0eee8d0c50e37ef832e3d7e21c383042639304b97f9c0f4e71be085e30f75d0e
Aug 04 18:02:10.984249 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984249 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zs2n\" (UniqueName: \"kubernetes.io/projected/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-kube-api-access-9zs2n\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-federate-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-serving-certs-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-metrics-client-ca\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984660 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:10.984660 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:10.984599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-federate-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-serving-certs-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-metrics-client-ca\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.085756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.085547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zs2n\" (UniqueName: \"kubernetes.io/projected/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-kube-api-access-9zs2n\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.087471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.087440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-serving-certs-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.087599 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.087561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.088071 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.088047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-metrics-client-ca\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.088931 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.088907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-telemeter-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.089562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.089519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.089562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.089541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.089684 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.089610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-federate-client-tls\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.098435 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.098411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zs2n\" (UniqueName: \"kubernetes.io/projected/0cabc3d9-2186-448d-a6d3-fd373d53b0b0-kube-api-access-9zs2n\") pod \"telemeter-client-fb88f68f5-4q77c\" (UID: \"0cabc3d9-2186-448d-a6d3-fd373d53b0b0\") " pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.221822 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.221746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c"
Aug 04 18:02:11.400319 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.400285    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb88f68f5-4q77c"]
Aug 04 18:02:11.405092 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:11.405064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cabc3d9_2186_448d_a6d3_fd373d53b0b0.slice/crio-f65a5204af5edd7859aab1bbf131cee9fedd8f534960dc5e9f96971bd182b321 WatchSource:0}: Error finding container f65a5204af5edd7859aab1bbf131cee9fedd8f534960dc5e9f96971bd182b321: Status 404 returned error can't find the container with id f65a5204af5edd7859aab1bbf131cee9fedd8f534960dc5e9f96971bd182b321
Aug 04 18:02:11.469052 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.469011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8zds" event={"ID":"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0","Type":"ContainerStarted","Data":"d3c02213a1f1f87e5320d51cca45eec77213e572fdfeaa20bb29c74c46139875"}
Aug 04 18:02:11.469205 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.469078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8zds" event={"ID":"52b22dc0-8f21-4a4a-9e0a-32ee731db4a0","Type":"ContainerStarted","Data":"3f8cc0b06bfdc756314f20f10a71e40a160bbfd99e4fa394dd957a52123d199e"}
Aug 04 18:02:11.470926 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.470877    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083" exitCode=0
Aug 04 18:02:11.471054 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.470933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"}
Aug 04 18:02:11.479647 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.479611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt" event={"ID":"e947580c-4029-474a-9838-9004b60758fa","Type":"ContainerStarted","Data":"da6a72aba54b4f583e9adaab1dd2ac67d8aa900fdf936251e2ab1a9662edcbb0"}
Aug 04 18:02:11.481286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.481253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c" event={"ID":"0cabc3d9-2186-448d-a6d3-fd373d53b0b0","Type":"ContainerStarted","Data":"f65a5204af5edd7859aab1bbf131cee9fedd8f534960dc5e9f96971bd182b321"}
Aug 04 18:02:11.482692 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.482655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn" event={"ID":"0ad28d0e-6e35-4e60-8c86-43402c56a845","Type":"ContainerStarted","Data":"0eee8d0c50e37ef832e3d7e21c383042639304b97f9c0f4e71be085e30f75d0e"}
Aug 04 18:02:11.484129 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.484089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr" event={"ID":"36150acf-7745-40b7-af5b-bbfc6f484257","Type":"ContainerStarted","Data":"7ae361e26819025e5a2fe707a300613df629b0bae677cc8bb044e6010ab76775"}
Aug 04 18:02:11.494485 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.494423    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8zds" podStartSLOduration=2.809565552 podStartE2EDuration="6.494404848s" totalImagesPullingTime="3.599701658s" totalInitContainerRuntime="85.137638ms" isStatefulPod=true podCreationTimestamp="2026-08-04 18:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:11.4936073 +0000 UTC m=+73.935759592" watchObservedRunningTime="2026-08-04 18:02:11.494404848 +0000 UTC m=+73.936557140"
Aug 04 18:02:11.528390 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.527822    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mh9mt" podStartSLOduration=5.4184491 podStartE2EDuration="6.527801172s" totalImagesPullingTime="1.109352072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:11.527146482 +0000 UTC m=+73.969298773" watchObservedRunningTime="2026-08-04 18:02:11.527801172 +0000 UTC m=+73.969953464"
Aug 04 18:02:11.729561 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.729117    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:11.761059 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.761012    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:11.765359 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.765336    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.773744 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.773686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:11.896663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xx5\" (UniqueName: \"kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.896934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.896873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.939748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.938500    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:02:11.943112 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.943086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:11.946815 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.946505    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.949627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.949871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.949961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.950082    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.950172    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.950264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:02:11.950499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.949871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:02:11.953578 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.952256    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lklkb\""
Aug 04 18:02:11.953578 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.952333    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ek9ose937ou63\""
Aug 04 18:02:11.953578 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.952467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:02:11.953578 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.952502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:02:11.955759 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.954635    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:02:11.955759 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.955584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:02:11.957027 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.956965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:02:11.958717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.958139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:02:11.969211 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.967934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:02:11.998258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xx5\" (UniqueName: \"kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.998471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.998443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.999244 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.999215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:11.999445 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:11.999395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.000195 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.000167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.000747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.000716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.004798 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.004774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.005848 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.005808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.011782 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.011737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xx5\" (UniqueName: \"kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5\") pod \"console-64b8d94c7-826mb\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") " pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.016272 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.015369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:12.082189 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.082152    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:12.099444 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.099941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978np\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.100735 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.100735 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.099993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.100735 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.100017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.200950 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.200906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.200965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978np\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.201965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.201816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.202302 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.202165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.203233 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.202882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.203233 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.203216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.204286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.203711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.204286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.203844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.204876 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.204565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.206330 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.206038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.206527 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.206501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.206829 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.206759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.206938 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.206873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.207296 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.207233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.207296 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.207238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.207405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.207311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.207405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.207388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.208417 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.208373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.208512 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.208484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.208667 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.208584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.210041 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.210016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.210413 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.210390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.222594 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.222565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978np\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np\") pod \"prometheus-k8s-0\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:12.262726 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:12.262650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:13.450450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:13.450423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:13.483321 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:13.483293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:02:13.771155 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:13.771122    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5fc0708_4e3c_4425_b7f0_09a024fdff04.slice/crio-bdb4f3709693004038fbf53ad9d3efd4401fdcbef3463cdcb379e19fa3ea280b WatchSource:0}: Error finding container bdb4f3709693004038fbf53ad9d3efd4401fdcbef3463cdcb379e19fa3ea280b: Status 404 returned error can't find the container with id bdb4f3709693004038fbf53ad9d3efd4401fdcbef3463cdcb379e19fa3ea280b
Aug 04 18:02:14.092665 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:14.092590    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14458adc_28d9_47a6_a084_91eacb3cc0d9.slice/crio-2663db54a793e1137e9cd05c4b8a66248572a52035b7c4dbf3d5b1036d498f12 WatchSource:0}: Error finding container 2663db54a793e1137e9cd05c4b8a66248572a52035b7c4dbf3d5b1036d498f12: Status 404 returned error can't find the container with id 2663db54a793e1137e9cd05c4b8a66248572a52035b7c4dbf3d5b1036d498f12
Aug 04 18:02:14.500435 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.500407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c" event={"ID":"0cabc3d9-2186-448d-a6d3-fd373d53b0b0","Type":"ContainerStarted","Data":"ca83828aa224a55c1ea8a96268aafe8e480fa1b1cbff81986b02eed09a845c35"}
Aug 04 18:02:14.500862 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.500846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c" event={"ID":"0cabc3d9-2186-448d-a6d3-fd373d53b0b0","Type":"ContainerStarted","Data":"6ddbf5c9ee035bb04904972bbf412c35597e9095fd4decda0b0e9368d14ad699"}
Aug 04 18:02:14.502801 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.502714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr" event={"ID":"36150acf-7745-40b7-af5b-bbfc6f484257","Type":"ContainerStarted","Data":"af9be05073f558195057a3a775a1447a640f28e9db30e26144fbde0c9633ef39"}
Aug 04 18:02:14.505761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.504984    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709" exitCode=0
Aug 04 18:02:14.505761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.505131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"}
Aug 04 18:02:14.505761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.505219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"bdb4f3709693004038fbf53ad9d3efd4401fdcbef3463cdcb379e19fa3ea280b"}
Aug 04 18:02:14.509339 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.509195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"35bb69202fb8f991679cb535a874c2315cfe0275ffe09e2ca6a5daaadadeadf3"}
Aug 04 18:02:14.509339 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.509272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"88b9b47682a10babe32f02fd8eca91a0a0b8c0d65470fa0fddf3b840b793f9df"}
Aug 04 18:02:14.511698 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.511671    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"}
Aug 04 18:02:14.511783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.511745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"}
Aug 04 18:02:14.514331 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.514281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b8d94c7-826mb" event={"ID":"14458adc-28d9-47a6-a084-91eacb3cc0d9","Type":"ContainerStarted","Data":"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"}
Aug 04 18:02:14.514423 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.514334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b8d94c7-826mb" event={"ID":"14458adc-28d9-47a6-a084-91eacb3cc0d9","Type":"ContainerStarted","Data":"2663db54a793e1137e9cd05c4b8a66248572a52035b7c4dbf3d5b1036d498f12"}
Aug 04 18:02:14.517042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.517022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn" event={"ID":"0ad28d0e-6e35-4e60-8c86-43402c56a845","Type":"ContainerStarted","Data":"be4529db1402cb6dc5bf2e7b12d3ed6a159f14695c5d70ba32e4eae3d2996e52"}
Aug 04 18:02:14.517485 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.517463    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:14.525971 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.525698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn"
Aug 04 18:02:14.526653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.526594    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr" podStartSLOduration=2.170510994 podStartE2EDuration="5.526578172s" totalImagesPullingTime="3.356067178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.526533935 +0000 UTC m=+76.968686265" watchObservedRunningTime="2026-08-04 18:02:14.526578172 +0000 UTC m=+76.968730464"
Aug 04 18:02:14.594448 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.594396    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-kr5qn" podStartSLOduration=1.775184271 podStartE2EDuration="4.594378995s" totalImagesPullingTime="2.819194724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.593787711 +0000 UTC m=+77.035940004" watchObservedRunningTime="2026-08-04 18:02:14.594378995 +0000 UTC m=+77.036531324"
Aug 04 18:02:14.616795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:14.616750    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64b8d94c7-826mb" podStartSLOduration=3.616730815 podStartE2EDuration="3.616730815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.616199114 +0000 UTC m=+77.058351416" watchObservedRunningTime="2026-08-04 18:02:14.616730815 +0000 UTC m=+77.058883110"
Aug 04 18:02:15.523906 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.523805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c" event={"ID":"0cabc3d9-2186-448d-a6d3-fd373d53b0b0","Type":"ContainerStarted","Data":"01bd6d0c031b37a5872bede94f3fd49fea13138909903d8dac77618cc447bb15"}
Aug 04 18:02:15.526842 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.526818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"33c71be04a6c148d46b10e5482112a5a966364ba429dc5ac783b2f668dff4706"}
Aug 04 18:02:15.526994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.526868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"e3c2fbe7eaba25ccbf9b5ad30a8c059beff07b7f4805177a465adbd0d9b44b78"}
Aug 04 18:02:15.526994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.526925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"d035de9bf0a31db4c6feb23bc4e644e02bd66b2a39c0d2f5ccd7c8441cfd24d8"}
Aug 04 18:02:15.526994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.526954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" event={"ID":"9c5ebdca-1a2a-4210-857d-8d3613482297","Type":"ContainerStarted","Data":"320eb8373e0946f053eb48db98d153542fd8ca88cdbd8022c2f00ef09c462e61"}
Aug 04 18:02:15.526994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.526988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:15.530157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.530134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"}
Aug 04 18:02:15.530250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.530188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"}
Aug 04 18:02:15.530250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.530215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"}
Aug 04 18:02:15.530250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.530241    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerStarted","Data":"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"}
Aug 04 18:02:15.563291 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.563249    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb88f68f5-4q77c" podStartSLOduration=2.822339884 podStartE2EDuration="5.563236075s" totalImagesPullingTime="2.740896191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:15.561700427 +0000 UTC m=+78.003852742" watchObservedRunningTime="2026-08-04 18:02:15.563236075 +0000 UTC m=+78.005388344"
Aug 04 18:02:15.639437 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.639394    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.875005752 podStartE2EDuration="9.639378212s" totalImagesPullingTime="4.743103001s" totalInitContainerRuntime="21.269459ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:15.635478964 +0000 UTC m=+78.077631254" watchObservedRunningTime="2026-08-04 18:02:15.639378212 +0000 UTC m=+78.081530506"
Aug 04 18:02:15.723941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.723873    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9" podStartSLOduration=4.615245879 podStartE2EDuration="8.723850226s" totalImagesPullingTime="4.108604347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:15.722841584 +0000 UTC m=+78.164993876" watchObservedRunningTime="2026-08-04 18:02:15.723850226 +0000 UTC m=+78.166002516"
Aug 04 18:02:15.731204 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.731179    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:15.801105 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.801031    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:02:15.804440 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.804426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.825115 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.825083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:02:15.944148 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqw6t\" (UniqueName: \"kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944148 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:15.944404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:15.944349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.045834 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.045802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.045998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.045871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.045998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.045902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.045998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.045916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.045998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.045995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqw6t\" (UniqueName: \"kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.046197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.046018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.046197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.046053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.046681 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.046653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.046681 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.046672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.046837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.046691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.047029 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.047006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.048968 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.048944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.049038 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.048975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.057152 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.057104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqw6t\" (UniqueName: \"kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t\") pod \"console-7554dcfb7b-rqwdl\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") " pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.113133 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.113099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:16.257329 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.257298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:02:16.260098 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:02:16.260069    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38543494_e183_451b_8688_26618ed8efef.slice/crio-13d0e7e562d9facf6edb0aad15b19236144129192b2f7195cf4604f4e793f372 WatchSource:0}: Error finding container 13d0e7e562d9facf6edb0aad15b19236144129192b2f7195cf4604f4e793f372: Status 404 returned error can't find the container with id 13d0e7e562d9facf6edb0aad15b19236144129192b2f7195cf4604f4e793f372
Aug 04 18:02:16.537546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.537491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7554dcfb7b-rqwdl" event={"ID":"38543494-e183-451b-8688-26618ed8efef","Type":"ContainerStarted","Data":"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"}
Aug 04 18:02:16.537998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.537553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7554dcfb7b-rqwdl" event={"ID":"38543494-e183-451b-8688-26618ed8efef","Type":"ContainerStarted","Data":"13d0e7e562d9facf6edb0aad15b19236144129192b2f7195cf4604f4e793f372"}
Aug 04 18:02:16.586737 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:16.586653    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7554dcfb7b-rqwdl" podStartSLOduration=1.5866369470000001 podStartE2EDuration="1.586636947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:16.585602101 +0000 UTC m=+79.027754394" watchObservedRunningTime="2026-08-04 18:02:16.586636947 +0000 UTC m=+79.028789237"
Aug 04 18:02:19.557750 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:19.557717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"}
Aug 04 18:02:19.558163 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:19.557805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"}
Aug 04 18:02:19.558163 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:19.557852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"}
Aug 04 18:02:19.558163 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:19.557909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"}
Aug 04 18:02:20.565481 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:20.565439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"}
Aug 04 18:02:20.565822 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:20.565521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerStarted","Data":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"}
Aug 04 18:02:20.600047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:20.600000    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.80315386 podStartE2EDuration="9.599985488s" totalImagesPullingTime="4.766147453s" totalInitContainerRuntime="30.684175ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:20.597108981 +0000 UTC m=+83.039261295" watchObservedRunningTime="2026-08-04 18:02:20.599985488 +0000 UTC m=+83.042137778"
Aug 04 18:02:21.545014 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:21.544987    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c4bb6d66d-kqhp9"
Aug 04 18:02:22.082806 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:22.082773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:22.263181 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:22.263146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:02:26.113964 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:26.113920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:26.114421 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:26.113998    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:26.118322 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:26.118301    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:26.595213 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:26.595186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:02:26.651022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:26.650986    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:02:30.352282 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:30.352250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:30.352653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:30.352310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:36.754429 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:36.754349    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b4f68cb5b-bvtsg" podUID="4ee81d99-ca81-4f7d-9902-079d188c62a6" containerName="console" containerID="cri-o://3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8" gracePeriod=15
Aug 04 18:02:36.999466 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:36.999443    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:37.044612 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tcts\" (UniqueName: \"kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.044990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.044802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert\") pod \"4ee81d99-ca81-4f7d-9902-079d188c62a6\" (UID: \"4ee81d99-ca81-4f7d-9902-079d188c62a6\") "
Aug 04 18:02:37.045093 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.045019    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:37.045258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.045214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config" (OuterVolumeSpecName: "console-config") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:37.045258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.045230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:37.045258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.045223    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-service-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.045474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.045280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:37.047040 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.047019    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:37.047160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.047139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:37.047260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.047241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts" (OuterVolumeSpecName: "kube-api-access-9tcts") pod "4ee81d99-ca81-4f7d-9902-079d188c62a6" (UID: "4ee81d99-ca81-4f7d-9902-079d188c62a6"). InnerVolumeSpecName "kube-api-access-9tcts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:02:37.146179 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146140    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.146179 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146171    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-oauth-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.146179 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146181    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.146179 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146189    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-oauth-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.146443 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146199    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee81d99-ca81-4f7d-9902-079d188c62a6-console-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.146443 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.146208    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tcts\" (UniqueName: \"kubernetes.io/projected/4ee81d99-ca81-4f7d-9902-079d188c62a6-kube-api-access-9tcts\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:37.645361 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.645321    2580 generic.go:356] "Generic (PLEG): container finished" podID="4ee81d99-ca81-4f7d-9902-079d188c62a6" containerID="3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8" exitCode=0
Aug 04 18:02:37.645519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.645373    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4f68cb5b-bvtsg"
Aug 04 18:02:37.645519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.645384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f68cb5b-bvtsg" event={"ID":"4ee81d99-ca81-4f7d-9902-079d188c62a6","Type":"ContainerDied","Data":"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"}
Aug 04 18:02:37.645519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.645435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4f68cb5b-bvtsg" event={"ID":"4ee81d99-ca81-4f7d-9902-079d188c62a6","Type":"ContainerDied","Data":"e4a9e0fa8eddec24c231a3dbaa5ccde0e67f0d40ab31b4f5c767eea6c27808bb"}
Aug 04 18:02:37.645519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.645462    2580 scope.go:117] "RemoveContainer" containerID="3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"
Aug 04 18:02:37.655219 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.655190    2580 scope.go:117] "RemoveContainer" containerID="3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"
Aug 04 18:02:37.655474 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:37.655453    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8\": container with ID starting with 3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8 not found: ID does not exist" containerID="3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"
Aug 04 18:02:37.655525 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.655483    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8"} err="failed to get container status \"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8\": rpc error: code = NotFound desc = could not find container \"3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8\": container with ID starting with 3c92c673f789dd1ea58335c3c8e376c031ebb67d6d9f0da9673b96b9086a58e8 not found: ID does not exist"
Aug 04 18:02:37.671563 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.671537    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:37.675242 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:37.675217    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4f68cb5b-bvtsg"]
Aug 04 18:02:38.145731 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:38.145698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee81d99-ca81-4f7d-9902-079d188c62a6" path="/var/lib/kubelet/pods/4ee81d99-ca81-4f7d-9902-079d188c62a6/volumes"
Aug 04 18:02:41.489263 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.487920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fsgwg"
Aug 04 18:02:41.557603 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.557553    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64b8d94c7-826mb" podUID="14458adc-28d9-47a6-a084-91eacb3cc0d9" containerName="console" containerID="cri-o://d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc" gracePeriod=15
Aug 04 18:02:41.899577 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.899351    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:41.995379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8xx5\" (UniqueName: \"kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995529 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995623 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995670 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995655    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config" (OuterVolumeSpecName: "console-config") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:41.995721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995711    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca\") pod \"14458adc-28d9-47a6-a084-91eacb3cc0d9\" (UID: \"14458adc-28d9-47a6-a084-91eacb3cc0d9\") "
Aug 04 18:02:41.995968 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:41.995968 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.995947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:41.996153 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.996135    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:41.996231 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.996156    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:41.996231 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.996172    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-oauth-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:41.996231 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.996196    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:41.997857 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.997831    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:41.997857 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.997843    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5" (OuterVolumeSpecName: "kube-api-access-b8xx5") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "kube-api-access-b8xx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:02:41.998149 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:41.998121    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14458adc-28d9-47a6-a084-91eacb3cc0d9" (UID: "14458adc-28d9-47a6-a084-91eacb3cc0d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:42.097503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.097424    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-oauth-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:42.097503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.097453    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14458adc-28d9-47a6-a084-91eacb3cc0d9-console-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:42.097503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.097462    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14458adc-28d9-47a6-a084-91eacb3cc0d9-service-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:42.097503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.097472    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8xx5\" (UniqueName: \"kubernetes.io/projected/14458adc-28d9-47a6-a084-91eacb3cc0d9-kube-api-access-b8xx5\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:42.673240 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.673204    2580 generic.go:356] "Generic (PLEG): container finished" podID="14458adc-28d9-47a6-a084-91eacb3cc0d9" containerID="d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc" exitCode=0
Aug 04 18:02:42.673654 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.673264    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b8d94c7-826mb"
Aug 04 18:02:42.673654 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.673275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b8d94c7-826mb" event={"ID":"14458adc-28d9-47a6-a084-91eacb3cc0d9","Type":"ContainerDied","Data":"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"}
Aug 04 18:02:42.673654 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.673329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b8d94c7-826mb" event={"ID":"14458adc-28d9-47a6-a084-91eacb3cc0d9","Type":"ContainerDied","Data":"2663db54a793e1137e9cd05c4b8a66248572a52035b7c4dbf3d5b1036d498f12"}
Aug 04 18:02:42.673654 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.673350    2580 scope.go:117] "RemoveContainer" containerID="d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"
Aug 04 18:02:42.682115 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.682092    2580 scope.go:117] "RemoveContainer" containerID="d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"
Aug 04 18:02:42.682451 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:42.682431    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc\": container with ID starting with d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc not found: ID does not exist" containerID="d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"
Aug 04 18:02:42.682540 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.682458    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc"} err="failed to get container status \"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc\": rpc error: code = NotFound desc = could not find container \"d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc\": container with ID starting with d59bd41cb6517d9df1a06b4969fb3e044653aefc1b690b59e6f286c2a72c71fc not found: ID does not exist"
Aug 04 18:02:42.694289 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.694263    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:42.699911 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:42.699866    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64b8d94c7-826mb"]
Aug 04 18:02:44.146134 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:44.146104    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14458adc-28d9-47a6-a084-91eacb3cc0d9" path="/var/lib/kubelet/pods/14458adc-28d9-47a6-a084-91eacb3cc0d9/volumes"
Aug 04 18:02:50.356840 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:50.356807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:50.360603 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:50.360580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fdb88df97-pwlcr"
Aug 04 18:02:51.669757 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.669716    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78559585b9-78wzs" podUID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" containerName="console" containerID="cri-o://8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9" gracePeriod=15
Aug 04 18:02:51.915507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.915485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:51.982662 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.982662 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982647    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.982866 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.982866 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.982866 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982775    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.982866 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.982800    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spxwk\" (UniqueName: \"kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk\") pod \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\" (UID: \"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d\") "
Aug 04 18:02:51.983142 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.983114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config" (OuterVolumeSpecName: "console-config") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:51.983207 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.983130    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:51.983207 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.983150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:02:51.985107 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.985078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:51.985201 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.985133    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:02:51.985201 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:51.985182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk" (OuterVolumeSpecName: "kube-api-access-spxwk") pod "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" (UID: "1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d"). InnerVolumeSpecName "kube-api-access-spxwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:02:52.083695 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083670    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-service-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.083695 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083691    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-oauth-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.083831 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083702    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spxwk\" (UniqueName: \"kubernetes.io/projected/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-kube-api-access-spxwk\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.083831 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083710    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.083831 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083719    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-console-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.083831 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.083727    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d-oauth-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:02:52.717711 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.717680    2580 generic.go:356] "Generic (PLEG): container finished" podID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" containerID="8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9" exitCode=0
Aug 04 18:02:52.718208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.717734    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78559585b9-78wzs"
Aug 04 18:02:52.718208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.717770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78559585b9-78wzs" event={"ID":"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d","Type":"ContainerDied","Data":"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"}
Aug 04 18:02:52.718208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.717820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78559585b9-78wzs" event={"ID":"1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d","Type":"ContainerDied","Data":"546689a65117b9fbad03cfc704114fcf037a25850f4e0d8bef9ade7aa10289d0"}
Aug 04 18:02:52.718208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.717840    2580 scope.go:117] "RemoveContainer" containerID="8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"
Aug 04 18:02:52.725664 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.725644    2580 scope.go:117] "RemoveContainer" containerID="8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"
Aug 04 18:02:52.725899 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:02:52.725871    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9\": container with ID starting with 8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9 not found: ID does not exist" containerID="8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"
Aug 04 18:02:52.725981 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.725904    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9"} err="failed to get container status \"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9\": rpc error: code = NotFound desc = could not find container \"8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9\": container with ID starting with 8078f64cddf878da54a01a51672add1e692f0dadbfde7d395a050b372b9ab0a9 not found: ID does not exist"
Aug 04 18:02:52.742450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.742419    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:02:52.747778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:52.747756    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78559585b9-78wzs"]
Aug 04 18:02:54.145775 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:02:54.145738    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" path="/var/lib/kubelet/pods/1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d/volumes"
Aug 04 18:03:12.263146 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:12.263117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:12.282771 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:12.282746    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:12.812906 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:12.812863    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:22.618487 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618453    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618781    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618791    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618800    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14458adc-28d9-47a6-a084-91eacb3cc0d9" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618805    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14458adc-28d9-47a6-a084-91eacb3cc0d9" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618821    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee81d99-ca81-4f7d-9902-079d188c62a6" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618827    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee81d99-ca81-4f7d-9902-079d188c62a6" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618871    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dde89c3-ffdd-4e3c-9385-c89e68fd1a0d" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618881    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee81d99-ca81-4f7d-9902-079d188c62a6" containerName="console"
Aug 04 18:03:22.618959 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.618902    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14458adc-28d9-47a6-a084-91eacb3cc0d9" containerName="console"
Aug 04 18:03:22.621107 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.621087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.633666 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.633639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:03:22.747646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zsh\" (UniqueName: \"kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.747981 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.747796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848406 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zsh\" (UniqueName: \"kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848536 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.848779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.848565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.849253 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.849231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.849384 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.849362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.849439 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.849378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.849513 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.849462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.850706 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.850688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.850843 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.850828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.858303 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.858283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zsh\" (UniqueName: \"kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh\") pod \"console-6dfc7d8594-zvfcs\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") " pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:22.930192 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:22.930163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:23.057873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:23.057850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:03:23.060170 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:03:23.060142    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a175164_374e_4548_808c_ff5e6f8ee1c8.slice/crio-640eb94f290121920a48211fa03718109e7b02f15cce6d10f6329659285469da WatchSource:0}: Error finding container 640eb94f290121920a48211fa03718109e7b02f15cce6d10f6329659285469da: Status 404 returned error can't find the container with id 640eb94f290121920a48211fa03718109e7b02f15cce6d10f6329659285469da
Aug 04 18:03:23.843028 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:23.842987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfc7d8594-zvfcs" event={"ID":"8a175164-374e-4548-808c-ff5e6f8ee1c8","Type":"ContainerStarted","Data":"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"}
Aug 04 18:03:23.843437 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:23.843072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfc7d8594-zvfcs" event={"ID":"8a175164-374e-4548-808c-ff5e6f8ee1c8","Type":"ContainerStarted","Data":"640eb94f290121920a48211fa03718109e7b02f15cce6d10f6329659285469da"}
Aug 04 18:03:23.864209 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:23.864164    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dfc7d8594-zvfcs" podStartSLOduration=1.8641492149999999 podStartE2EDuration="1.864149215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:03:23.863042382 +0000 UTC m=+146.305194675" watchObservedRunningTime="2026-08-04 18:03:23.864149215 +0000 UTC m=+146.306301505"
Aug 04 18:03:26.059939 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.059906    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:26.060351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060182    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="alertmanager" containerID="cri-o://304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589" gracePeriod=120
Aug 04 18:03:26.060351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060251    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-metric" containerID="cri-o://1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b" gracePeriod=120
Aug 04 18:03:26.060351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060304    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="config-reloader" containerID="cri-o://b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233" gracePeriod=120
Aug 04 18:03:26.060351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060302    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-web" containerID="cri-o://cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c" gracePeriod=120
Aug 04 18:03:26.060351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060314    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy" containerID="cri-o://c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623" gracePeriod=120
Aug 04 18:03:26.060645 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.060279    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="prom-label-proxy" containerID="cri-o://c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523" gracePeriod=120
Aug 04 18:03:26.858565 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858529    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523" exitCode=0
Aug 04 18:03:26.858565 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858560    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623" exitCode=0
Aug 04 18:03:26.858565 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858568    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233" exitCode=0
Aug 04 18:03:26.858565 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858576    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589" exitCode=0
Aug 04 18:03:26.858833 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"}
Aug 04 18:03:26.858833 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"}
Aug 04 18:03:26.858833 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"}
Aug 04 18:03:26.858833 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:26.858736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"}
Aug 04 18:03:27.306408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.306381    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.388279 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388367    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388449    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztnkv\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388523    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388548    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume\") pod \"74b2f691-9c98-4afe-918f-8db80a4e20e5\" (UID: \"74b2f691-9c98-4afe-918f-8db80a4e20e5\") "
Aug 04 18:03:27.388985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388861    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:27.388985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.388878    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:27.389186 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.389125    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-metrics-client-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.389186 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.389146    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.389186 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.389125    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:03:27.392351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.391730    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.392351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.392093    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out" (OuterVolumeSpecName: "config-out") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:03:27.392351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.392240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.392638 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.392613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.393007 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.392974    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:27.393095 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.393071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv" (OuterVolumeSpecName: "kube-api-access-ztnkv") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "kube-api-access-ztnkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:27.393182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.393158    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume" (OuterVolumeSpecName: "config-volume") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.393245 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.393220    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.396434 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.396408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.403493 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.403466    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config" (OuterVolumeSpecName: "web-config") pod "74b2f691-9c98-4afe-918f-8db80a4e20e5" (UID: "74b2f691-9c98-4afe-918f-8db80a4e20e5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:27.489927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489872    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztnkv\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-kube-api-access-ztnkv\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.489927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489922    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b2f691-9c98-4afe-918f-8db80a4e20e5-tls-assets\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.489927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489935    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-web-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489949    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489961    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-cluster-tls-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489973    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489986    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-volume\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.489998    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-main-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.490010    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b2f691-9c98-4afe-918f-8db80a4e20e5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.490022    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-alertmanager-main-db\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.490161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.490033    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b2f691-9c98-4afe-918f-8db80a4e20e5-config-out\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:27.866100 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866019    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b" exitCode=0
Aug 04 18:03:27.866100 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866050    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerID="cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c" exitCode=0
Aug 04 18:03:27.866346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866111    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.866346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"}
Aug 04 18:03:27.866346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866248    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"}
Aug 04 18:03:27.866346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b2f691-9c98-4afe-918f-8db80a4e20e5","Type":"ContainerDied","Data":"537b8a9085210e5bba2f677cfa4e37171d699340b371189b3df4955576ff27f9"}
Aug 04 18:03:27.866346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.866308    2580 scope.go:117] "RemoveContainer" containerID="c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"
Aug 04 18:03:27.874256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.874238    2580 scope.go:117] "RemoveContainer" containerID="1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"
Aug 04 18:03:27.881329 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.881310    2580 scope.go:117] "RemoveContainer" containerID="c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"
Aug 04 18:03:27.887871 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.887850    2580 scope.go:117] "RemoveContainer" containerID="cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"
Aug 04 18:03:27.893212 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.893164    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:27.895745 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.895721    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:27.896150 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.896137    2580 scope.go:117] "RemoveContainer" containerID="b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"
Aug 04 18:03:27.903160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.903146    2580 scope.go:117] "RemoveContainer" containerID="304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"
Aug 04 18:03:27.911479 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.911460    2580 scope.go:117] "RemoveContainer" containerID="5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"
Aug 04 18:03:27.918707 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.918690    2580 scope.go:117] "RemoveContainer" containerID="c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"
Aug 04 18:03:27.919045 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.919026    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523\": container with ID starting with c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523 not found: ID does not exist" containerID="c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"
Aug 04 18:03:27.919107 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919059    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"} err="failed to get container status \"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523\": rpc error: code = NotFound desc = could not find container \"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523\": container with ID starting with c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523 not found: ID does not exist"
Aug 04 18:03:27.919107 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919078    2580 scope.go:117] "RemoveContainer" containerID="1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"
Aug 04 18:03:27.919333 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.919316    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b\": container with ID starting with 1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b not found: ID does not exist" containerID="1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"
Aug 04 18:03:27.919385 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919342    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"} err="failed to get container status \"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b\": rpc error: code = NotFound desc = could not find container \"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b\": container with ID starting with 1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b not found: ID does not exist"
Aug 04 18:03:27.919385 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919361    2580 scope.go:117] "RemoveContainer" containerID="c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"
Aug 04 18:03:27.919572 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.919554    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623\": container with ID starting with c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623 not found: ID does not exist" containerID="c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"
Aug 04 18:03:27.919633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919579    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"} err="failed to get container status \"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623\": rpc error: code = NotFound desc = could not find container \"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623\": container with ID starting with c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623 not found: ID does not exist"
Aug 04 18:03:27.919633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919602    2580 scope.go:117] "RemoveContainer" containerID="cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"
Aug 04 18:03:27.919816 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.919794    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c\": container with ID starting with cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c not found: ID does not exist" containerID="cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"
Aug 04 18:03:27.919864 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919823    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"} err="failed to get container status \"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c\": rpc error: code = NotFound desc = could not find container \"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c\": container with ID starting with cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c not found: ID does not exist"
Aug 04 18:03:27.919864 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.919842    2580 scope.go:117] "RemoveContainer" containerID="b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"
Aug 04 18:03:27.920088 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.920070    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233\": container with ID starting with b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233 not found: ID does not exist" containerID="b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"
Aug 04 18:03:27.920128 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920092    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"} err="failed to get container status \"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233\": rpc error: code = NotFound desc = could not find container \"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233\": container with ID starting with b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233 not found: ID does not exist"
Aug 04 18:03:27.920128 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920106    2580 scope.go:117] "RemoveContainer" containerID="304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"
Aug 04 18:03:27.920348 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.920329    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589\": container with ID starting with 304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589 not found: ID does not exist" containerID="304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"
Aug 04 18:03:27.920395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920352    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"} err="failed to get container status \"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589\": rpc error: code = NotFound desc = could not find container \"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589\": container with ID starting with 304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589 not found: ID does not exist"
Aug 04 18:03:27.920395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920369    2580 scope.go:117] "RemoveContainer" containerID="5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"
Aug 04 18:03:27.920587 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:27.920567    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083\": container with ID starting with 5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083 not found: ID does not exist" containerID="5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"
Aug 04 18:03:27.920633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920590    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"} err="failed to get container status \"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083\": rpc error: code = NotFound desc = could not find container \"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083\": container with ID starting with 5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083 not found: ID does not exist"
Aug 04 18:03:27.920633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920603    2580 scope.go:117] "RemoveContainer" containerID="c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"
Aug 04 18:03:27.920830 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920814    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523"} err="failed to get container status \"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523\": rpc error: code = NotFound desc = could not find container \"c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523\": container with ID starting with c52aee54c860f43c2b0add9d25e2612a91dab6671d8fd83a14f9d5344f0ae523 not found: ID does not exist"
Aug 04 18:03:27.920830 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.920829    2580 scope.go:117] "RemoveContainer" containerID="1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"
Aug 04 18:03:27.921083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921067    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b"} err="failed to get container status \"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b\": rpc error: code = NotFound desc = could not find container \"1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b\": container with ID starting with 1501ee2546a150b3b5af0e2886976c5cd0be5d5b7ed37f9ed3074eaf9b931f0b not found: ID does not exist"
Aug 04 18:03:27.921148 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921084    2580 scope.go:117] "RemoveContainer" containerID="c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"
Aug 04 18:03:27.921294 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921279    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623"} err="failed to get container status \"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623\": rpc error: code = NotFound desc = could not find container \"c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623\": container with ID starting with c9e4519532741f6689cb1ccd4d11cbd1f2de0d69bb12675bba14ed76102a6623 not found: ID does not exist"
Aug 04 18:03:27.921342 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921294    2580 scope.go:117] "RemoveContainer" containerID="cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"
Aug 04 18:03:27.921527 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921508    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c"} err="failed to get container status \"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c\": rpc error: code = NotFound desc = could not find container \"cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c\": container with ID starting with cfd13ac2d431b788e31c6c772be525c8c2de7dcd07a11ac62002a5b50812543c not found: ID does not exist"
Aug 04 18:03:27.921569 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921528    2580 scope.go:117] "RemoveContainer" containerID="b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"
Aug 04 18:03:27.921741 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921724    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233"} err="failed to get container status \"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233\": rpc error: code = NotFound desc = could not find container \"b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233\": container with ID starting with b4978cfeb07a92d9d6c2bbf4643640d90bd147b92399adfcb1c6e5acc70b1233 not found: ID does not exist"
Aug 04 18:03:27.921785 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921742    2580 scope.go:117] "RemoveContainer" containerID="304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"
Aug 04 18:03:27.921952 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921936    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589"} err="failed to get container status \"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589\": rpc error: code = NotFound desc = could not find container \"304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589\": container with ID starting with 304d84cccd75acc41bc2b941702b4bc295fbd35fe86ee06670ffb6f79bb3c589 not found: ID does not exist"
Aug 04 18:03:27.922010 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.921952    2580 scope.go:117] "RemoveContainer" containerID="5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"
Aug 04 18:03:27.922170 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.922153    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083"} err="failed to get container status \"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083\": rpc error: code = NotFound desc = could not find container \"5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083\": container with ID starting with 5b1fa1b8258690b2912815078bc6ac7eca5aece0fb5b1442d61ad4b97de91083 not found: ID does not exist"
Aug 04 18:03:27.927914 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.927876    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:27.928208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928194    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-metric"
Aug 04 18:03:27.928251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928211    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-metric"
Aug 04 18:03:27.928251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928226    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="config-reloader"
Aug 04 18:03:27.928251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928233    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="config-reloader"
Aug 04 18:03:27.928251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928241    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy"
Aug 04 18:03:27.928251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928246    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928260    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="alertmanager"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928266    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="alertmanager"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928275    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-web"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928280    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-web"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928288    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="prom-label-proxy"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928293    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="prom-label-proxy"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928300    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="init-config-reloader"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928305    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="init-config-reloader"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928355    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="prom-label-proxy"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928362    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928368    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="config-reloader"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928374    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-metric"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928379    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="alertmanager"
Aug 04 18:03:27.928399 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.928384    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" containerName="kube-rbac-proxy-web"
Aug 04 18:03:27.932595 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.932577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.935409 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:03:27.935611 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935593    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:03:27.935611 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:03:27.935724 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935698    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:03:27.935927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:03:27.936049 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.935965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:03:27.936298 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.936282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:03:27.936386 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.936319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ksrgz\""
Aug 04 18:03:27.936386 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.936333    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:03:27.941078 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.941060    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:03:27.946222 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.946197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:27.993849 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.993817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.993849 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.993852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-web-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.993876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.993984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvdks\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-kube-api-access-gvdks\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:27.994405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:27.994255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-out\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.094991 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.094958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-web-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.094991 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.094997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvdks\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-kube-api-access-gvdks\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-out\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.095934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.096022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.095974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.096081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.096062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc130e23-8969-4fc9-905a-8b35a0dc66e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098146 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098345 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-web-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098876 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.098876 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.099057 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.099057 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.098970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc130e23-8969-4fc9-905a-8b35a0dc66e2-config-out\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.100040 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.100026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc130e23-8969-4fc9-905a-8b35a0dc66e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.105243 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.105224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvdks\" (UniqueName: \"kubernetes.io/projected/bc130e23-8969-4fc9-905a-8b35a0dc66e2-kube-api-access-gvdks\") pod \"alertmanager-main-0\" (UID: \"bc130e23-8969-4fc9-905a-8b35a0dc66e2\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.145723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.145696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b2f691-9c98-4afe-918f-8db80a4e20e5" path="/var/lib/kubelet/pods/74b2f691-9c98-4afe-918f-8db80a4e20e5/volumes"
Aug 04 18:03:28.243196 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.243162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:03:28.384275 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.384249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:03:28.386328 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:03:28.386296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc130e23_8969_4fc9_905a_8b35a0dc66e2.slice/crio-d6ca71d57c523be6ccfa4bd324b643ff42e6bfaeebfd141d8254de0cf7f0b91e WatchSource:0}: Error finding container d6ca71d57c523be6ccfa4bd324b643ff42e6bfaeebfd141d8254de0cf7f0b91e: Status 404 returned error can't find the container with id d6ca71d57c523be6ccfa4bd324b643ff42e6bfaeebfd141d8254de0cf7f0b91e
Aug 04 18:03:28.872049 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.871965    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc130e23-8969-4fc9-905a-8b35a0dc66e2" containerID="46f8dda2d3a362e91100b5bd0ad173e766a1cf9bd3b449c902fbba5da3d16793" exitCode=0
Aug 04 18:03:28.872049 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.872012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerDied","Data":"46f8dda2d3a362e91100b5bd0ad173e766a1cf9bd3b449c902fbba5da3d16793"}
Aug 04 18:03:28.872229 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:28.872088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"d6ca71d57c523be6ccfa4bd324b643ff42e6bfaeebfd141d8254de0cf7f0b91e"}
Aug 04 18:03:29.880416 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"75c991694b1e1f852785ee6724251be451402b6277b4af321304998e9a65fbb4"}
Aug 04 18:03:29.880783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"6ddccb5ee4f6f66a7e78b9eff6aed488a1fdcae40cecc11ccb551670e24609f8"}
Aug 04 18:03:29.880783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"0e8a79fbcd499a5c61369c71a11124c01f4fd3b8c7bf6d8f96660bd3ebad3b58"}
Aug 04 18:03:29.880783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"b1d8a3b3e29d8fbeb864b424ad0a6d6dac2e0d4d0100c1919bff0d8fd86df6c0"}
Aug 04 18:03:29.880783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"580aa67c53c299bf5a4830b09e79dc9a39a4aeaf5f37975f45e635a969ead36a"}
Aug 04 18:03:29.880783 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.880561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc130e23-8969-4fc9-905a-8b35a0dc66e2","Type":"ContainerStarted","Data":"c61b87e249c4be7797c221a6e3fcad5dd6e7551bb4f28dd506b0940c3c2186dc"}
Aug 04 18:03:29.913479 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:29.913422    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.898796998 podStartE2EDuration="2.913401825s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.604827ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:03:29.912151977 +0000 UTC m=+152.354304271" watchObservedRunningTime="2026-08-04 18:03:29.913401825 +0000 UTC m=+152.355554114"
Aug 04 18:03:30.314930 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.314838    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:30.315274 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315234    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="prometheus" containerID="cri-o://e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e" gracePeriod=600
Aug 04 18:03:30.315442 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315315    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="config-reloader" containerID="cri-o://ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1" gracePeriod=600
Aug 04 18:03:30.315442 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315309    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="thanos-sidecar" containerID="cri-o://57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2" gracePeriod=600
Aug 04 18:03:30.315442 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315346    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy" containerID="cri-o://c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f" gracePeriod=600
Aug 04 18:03:30.315442 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315230    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432" gracePeriod=600
Aug 04 18:03:30.315658 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.315446    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-web" containerID="cri-o://6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63" gracePeriod=600
Aug 04 18:03:30.560035 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.560009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:30.621261 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621185    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.621261 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621236    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.621460 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.621460 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.621460 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621931    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978np\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.621978    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622309    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db\") pod \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\" (UID: \"d5fc0708-4e3c-4425-b7f0-09a024fdff04\") "
Aug 04 18:03:30.623123 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.622880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.623995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.623261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.623995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.623604    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.623995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.623875    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.626251 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.624699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.627022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.626703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config" (OuterVolumeSpecName: "config") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.627022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.626738    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.627022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.626857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.627022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.626973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.627022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.627337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:03:30.627337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627122    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.627337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627224    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:30.627503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627365    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.628027 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.627995    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.628519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.628483    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:30.628763 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.628726    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np" (OuterVolumeSpecName: "kube-api-access-978np") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "kube-api-access-978np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:30.630526 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.630491    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.630688 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.630669    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out" (OuterVolumeSpecName: "config-out") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:03:30.644646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.644612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config" (OuterVolumeSpecName: "web-config") pod "d5fc0708-4e3c-4425-b7f0-09a024fdff04" (UID: "d5fc0708-4e3c-4425-b7f0-09a024fdff04"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:30.723216 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723184    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-grpc-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723216 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723210    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-tls-assets\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723216 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723220    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-metrics-client-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723229    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723238    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config-out\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723246    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978np\" (UniqueName: \"kubernetes.io/projected/d5fc0708-4e3c-4425-b7f0-09a024fdff04-kube-api-access-978np\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723255    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723264    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-kube-rbac-proxy\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723274    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723283    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-web-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723292    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723305    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723314    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723323    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723331    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5fc0708-4e3c-4425-b7f0-09a024fdff04-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723341    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d5fc0708-4e3c-4425-b7f0-09a024fdff04-prometheus-k8s-db\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723349    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-metrics-client-certs\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723357    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723371    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.723430 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.723380    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5fc0708-4e3c-4425-b7f0-09a024fdff04-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:30.887969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887940    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432" exitCode=0
Aug 04 18:03:30.887969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887964    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f" exitCode=0
Aug 04 18:03:30.887969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887970    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63" exitCode=0
Aug 04 18:03:30.887969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887976    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2" exitCode=0
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887981    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1" exitCode=0
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.887986    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e" exitCode=0
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888014    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888195    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"}
Aug 04 18:03:30.888474 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.888282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d5fc0708-4e3c-4425-b7f0-09a024fdff04","Type":"ContainerDied","Data":"bdb4f3709693004038fbf53ad9d3efd4401fdcbef3463cdcb379e19fa3ea280b"}
Aug 04 18:03:30.896009 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.895792    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.903183 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.903165    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.909600 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.909585    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.915607 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.915582    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:30.917130 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.917070    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.919954 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.919933    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:30.924052 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.924036    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.930926 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.930912    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.937225 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.937204    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.937544 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.937510    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.937634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.937552    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.937634 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.937573    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.937850 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.937836    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.937900 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.937854    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.937900 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.937871    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.938124 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.938107    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.938171 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938129    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.938171 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938146    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.938382 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.938363    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.938424 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938386    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.938424 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938401    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.938678 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.938662    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.938717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938683    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.938717 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938697    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.938953 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.938932    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.939026 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938956    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.939026 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.938972    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.939221 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:03:30.939203    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.939286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939224    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.939286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939238    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.939464 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939447    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.939542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939467    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.939678 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939663    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.939724 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939679    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.939873 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939854    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.939971 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.939875    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.940181 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940164    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.940250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940183    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.940394 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940377    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.940455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940397    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.940629 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940611    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.940671 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940630    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.940837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940817    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.940901 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.940839    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.941064 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941049    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.941110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941064    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.941233 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941219    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.941280 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941233    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.941408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941392    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.941454 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941410    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.941598 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941583    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.941640 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941598    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.941759 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941745    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.941759 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941758    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.941976 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941960    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.942027 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.941975    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.942157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942138    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.942221 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942160    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.942342 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942326    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.942406 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942343    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.942555 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942540    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.942619 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942556    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.942760 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942743    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.942801 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942761    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.942958 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942939    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.943011 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.942958    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.943165 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.943233 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943166    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.943372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943357    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.943414 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943372    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.943587 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943568    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.943657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943587    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.943795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943780    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.943795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.943795    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.944021 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944004    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.944076 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944022    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.944224 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944209    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.944271 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944225    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.944452 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944434    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.944494 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944454    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.944642 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944628    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.944692 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944642    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.944848 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944833    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.944917 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.944848    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.945057 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945040    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.945097 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945057    2580 scope.go:117] "RemoveContainer" containerID="a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"
Aug 04 18:03:30.945237 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945223    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432"} err="failed to get container status \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": rpc error: code = NotFound desc = could not find container \"a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432\": container with ID starting with a0363c1e15aa4fb8ef3d4306de154be040118c8d178e8fae4a45506b0fae5432 not found: ID does not exist"
Aug 04 18:03:30.945279 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945238    2580 scope.go:117] "RemoveContainer" containerID="c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"
Aug 04 18:03:30.945483 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945445    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f"} err="failed to get container status \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": rpc error: code = NotFound desc = could not find container \"c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f\": container with ID starting with c5916af1755c48f87552cc851a05d04e97494241b30bedb61c7f14b278e1775f not found: ID does not exist"
Aug 04 18:03:30.945483 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945463    2580 scope.go:117] "RemoveContainer" containerID="6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"
Aug 04 18:03:30.945863 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945832    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63"} err="failed to get container status \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": rpc error: code = NotFound desc = could not find container \"6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63\": container with ID starting with 6b49df964a1646bc41313ab3fc6604d5d4860ee4eb33f5c779d635dd2ce46b63 not found: ID does not exist"
Aug 04 18:03:30.945863 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.945858    2580 scope.go:117] "RemoveContainer" containerID="57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"
Aug 04 18:03:30.946259 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946241    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2"} err="failed to get container status \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": rpc error: code = NotFound desc = could not find container \"57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2\": container with ID starting with 57578b6ee0591d74f2b6fac319f2f708cf44f1fa33fa99ad123bb422071148f2 not found: ID does not exist"
Aug 04 18:03:30.946352 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946260    2580 scope.go:117] "RemoveContainer" containerID="ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"
Aug 04 18:03:30.946614 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946568    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1"} err="failed to get container status \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": rpc error: code = NotFound desc = could not find container \"ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1\": container with ID starting with ee32468cd267870fe6ad52facf59aaffda9fc904f56ca84f757b932aa08536b1 not found: ID does not exist"
Aug 04 18:03:30.946614 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946596    2580 scope.go:117] "RemoveContainer" containerID="e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"
Aug 04 18:03:30.946842 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946824    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e"} err="failed to get container status \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": rpc error: code = NotFound desc = could not find container \"e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e\": container with ID starting with e6eea2b8b2b8b8649c30698883a7db7ba8d958403d19f83c174b6aeeb7eda65e not found: ID does not exist"
Aug 04 18:03:30.946946 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.946843    2580 scope.go:117] "RemoveContainer" containerID="c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"
Aug 04 18:03:30.947110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.947089    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709"} err="failed to get container status \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": rpc error: code = NotFound desc = could not find container \"c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709\": container with ID starting with c1e3e66ac4822a0b357bf154ec105d5f047b9eff499ab2f601cf9b69b28e1709 not found: ID does not exist"
Aug 04 18:03:30.947707 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.947692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:30.948008 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.947997    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="prometheus"
Aug 04 18:03:30.948048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948010    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="prometheus"
Aug 04 18:03:30.948048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948022    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy"
Aug 04 18:03:30.948048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948027    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy"
Aug 04 18:03:30.948048 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948044    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-thanos"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948053    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-thanos"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948064    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="thanos-sidecar"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948070    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="thanos-sidecar"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948082    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="init-config-reloader"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948102    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="init-config-reloader"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948111    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="config-reloader"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948117    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="config-reloader"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948123    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-web"
Aug 04 18:03:30.948160 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948128    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-web"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948171    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="config-reloader"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948178    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-web"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948186    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948192    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="prometheus"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948197    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="kube-rbac-proxy-thanos"
Aug 04 18:03:30.948402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.948205    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" containerName="thanos-sidecar"
Aug 04 18:03:30.951477 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.951462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:30.954390 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954370    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:03:30.954390 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:03:30.954538 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lklkb\""
Aug 04 18:03:30.954538 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:03:30.954642 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:03:30.954642 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:03:30.954642 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:03:30.954960 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954941    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:03:30.954960 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.954959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:03:30.955188 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.955165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:03:30.955286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.955189    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:03:30.955286 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.955253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:03:30.955490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.955472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:03:30.955557 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.955532    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ek9ose937ou63\""
Aug 04 18:03:30.957968 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.957949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:03:30.960125 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.960110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:03:30.970386 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:30.970365    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:31.025041 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025147 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025147 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025147 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025147 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-web-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025432 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025432 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025520 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025557 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025610 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025610 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lhd\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-kube-api-access-s6lhd\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025708 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config-out\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025708 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025813 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025813 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.025928 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.025837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.126984 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.126954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config-out\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.126987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.127343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.127962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-web-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128256 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lhd\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-kube-api-access-s6lhd\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.128748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.129066 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.129066 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.128045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.130021 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.129973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config-out\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.130164 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.130142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.130230 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.130199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.130562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.130478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.130754 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.130728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.131266 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.131240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.131390 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.131341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.131521 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.131498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.131624 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.131599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.131682 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.131613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.132494 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.132471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-web-config\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.132708 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.132689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.132914 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.132876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.133253 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.133238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.137818 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.137802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lhd\" (UniqueName: \"kubernetes.io/projected/be05d5b3-b0c4-491b-8ee0-f8218b59aa75-kube-api-access-s6lhd\") pod \"prometheus-k8s-0\" (UID: \"be05d5b3-b0c4-491b-8ee0-f8218b59aa75\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.261506 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.261440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:31.396924 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.396877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:03:31.399605 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:03:31.399571    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe05d5b3_b0c4_491b_8ee0_f8218b59aa75.slice/crio-d98a38c453dc9cf173fab1cd1f0057a59e46ae2d995af5954ba2e78eed8f444a WatchSource:0}: Error finding container d98a38c453dc9cf173fab1cd1f0057a59e46ae2d995af5954ba2e78eed8f444a: Status 404 returned error can't find the container with id d98a38c453dc9cf173fab1cd1f0057a59e46ae2d995af5954ba2e78eed8f444a
Aug 04 18:03:31.894018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.893986    2580 generic.go:356] "Generic (PLEG): container finished" podID="be05d5b3-b0c4-491b-8ee0-f8218b59aa75" containerID="3eb1763c27ee85819d0669c88515c41422c2680fd343d79f176bf2c1b6c83ca6" exitCode=0
Aug 04 18:03:31.894445 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.894077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerDied","Data":"3eb1763c27ee85819d0669c88515c41422c2680fd343d79f176bf2c1b6c83ca6"}
Aug 04 18:03:31.894445 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:31.894150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"d98a38c453dc9cf173fab1cd1f0057a59e46ae2d995af5954ba2e78eed8f444a"}
Aug 04 18:03:32.148993 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.148964    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5fc0708-4e3c-4425-b7f0-09a024fdff04" path="/var/lib/kubelet/pods/d5fc0708-4e3c-4425-b7f0-09a024fdff04/volumes"
Aug 04 18:03:32.901635 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"85a5827d3331ac8fdb134d6e0c763167b3be505a8f0a592868232f92ce70b186"}
Aug 04 18:03:32.902018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"39c013a1f7a91afdffb259123fce9784d33f984421e2af2727137508460aae32"}
Aug 04 18:03:32.902018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"3548fbf28d07b11d8a343d36245368899cddda7b9b578e0c128c62d30ae7f186"}
Aug 04 18:03:32.902018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"9a08e296d89123382e3335141da1f14948a186f9bd9762f40d2b5f355c565ae1"}
Aug 04 18:03:32.902018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901792    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"d92f80d5b05fe0c197eb5fb49647d4d29a9a78f28740124143520dd28f8a5213"}
Aug 04 18:03:32.902018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.901831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"be05d5b3-b0c4-491b-8ee0-f8218b59aa75","Type":"ContainerStarted","Data":"ccbd32b611e91fd6a6714f510cccec2ca8dacf018e0ede80833a051536563fde"}
Aug 04 18:03:32.931022 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.930977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:32.931206 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.931049    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:32.936558 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.936520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:32.937513 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:32.937458    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9192513 podStartE2EDuration="2.937439692s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.188392ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:03:32.934529912 +0000 UTC m=+155.376682216" watchObservedRunningTime="2026-08-04 18:03:32.937439692 +0000 UTC m=+155.379591985"
Aug 04 18:03:33.909500 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:33.909469    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:03:33.965547 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:33.965512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:03:36.262343 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:36.262312    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:03:58.988941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:58.988866    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7554dcfb7b-rqwdl" podUID="38543494-e183-451b-8688-26618ed8efef" containerName="console" containerID="cri-o://b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757" gracePeriod=15
Aug 04 18:03:59.250176 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.250116    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:03:59.275630 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275603    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275652    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqw6t\" (UniqueName: \"kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275967 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275967 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.275967 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275929    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca\") pod \"38543494-e183-451b-8688-26618ed8efef\" (UID: \"38543494-e183-451b-8688-26618ed8efef\") "
Aug 04 18:03:59.276113 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.275962    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:59.276653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.276351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config" (OuterVolumeSpecName: "console-config") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:59.276653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.276576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca" (OuterVolumeSpecName: "service-ca") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:59.276653 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.276610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:03:59.276929 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.276784    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-oauth-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.278146 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.278114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t" (OuterVolumeSpecName: "kube-api-access-wqw6t") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "kube-api-access-wqw6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:03:59.278277 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.278257    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:59.278674 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.278646    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38543494-e183-451b-8688-26618ed8efef" (UID: "38543494-e183-451b-8688-26618ed8efef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:03:59.377961 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377926    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-console-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.377961 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377954    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-service-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.377961 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377964    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqw6t\" (UniqueName: \"kubernetes.io/projected/38543494-e183-451b-8688-26618ed8efef-kube-api-access-wqw6t\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.378169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377973    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.378169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377981    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38543494-e183-451b-8688-26618ed8efef-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:03:59.378169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:03:59.377991    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38543494-e183-451b-8688-26618ed8efef-console-oauth-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:04:00.010409 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.010379    2580 generic.go:356] "Generic (PLEG): container finished" podID="38543494-e183-451b-8688-26618ed8efef" containerID="b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757" exitCode=0
Aug 04 18:04:00.010874 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.010422    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7554dcfb7b-rqwdl"
Aug 04 18:04:00.010874 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.010422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7554dcfb7b-rqwdl" event={"ID":"38543494-e183-451b-8688-26618ed8efef","Type":"ContainerDied","Data":"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"}
Aug 04 18:04:00.010874 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.010572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7554dcfb7b-rqwdl" event={"ID":"38543494-e183-451b-8688-26618ed8efef","Type":"ContainerDied","Data":"13d0e7e562d9facf6edb0aad15b19236144129192b2f7195cf4604f4e793f372"}
Aug 04 18:04:00.010874 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.010614    2580 scope.go:117] "RemoveContainer" containerID="b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"
Aug 04 18:04:00.019416 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.019401    2580 scope.go:117] "RemoveContainer" containerID="b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"
Aug 04 18:04:00.019677 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:04:00.019658    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757\": container with ID starting with b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757 not found: ID does not exist" containerID="b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"
Aug 04 18:04:00.019739 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.019685    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757"} err="failed to get container status \"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757\": rpc error: code = NotFound desc = could not find container \"b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757\": container with ID starting with b8993360323742907d92bf4f3c9854d176f73797e33509a6f21c29c369473757 not found: ID does not exist"
Aug 04 18:04:00.034348 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.034323    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:04:00.038727 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.038704    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7554dcfb7b-rqwdl"]
Aug 04 18:04:00.146204 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:00.146173    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38543494-e183-451b-8688-26618ed8efef" path="/var/lib/kubelet/pods/38543494-e183-451b-8688-26618ed8efef/volumes"
Aug 04 18:04:31.262569 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:31.262530    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:04:31.277715 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:31.277693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:04:32.156644 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:04:32.156618    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:05:58.031535 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:05:58.031504    2580 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 18:09:37.413545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.413508    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-8588677cfb-59frw"]
Aug 04 18:09:37.414110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.414089    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38543494-e183-451b-8688-26618ed8efef" containerName="console"
Aug 04 18:09:37.414110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.414107    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38543494-e183-451b-8688-26618ed8efef" containerName="console"
Aug 04 18:09:37.414258 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.414204    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38543494-e183-451b-8688-26618ed8efef" containerName="console"
Aug 04 18:09:37.417073 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.417053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.420284 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.420258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Aug 04 18:09:37.444542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-8l5hk\""
Aug 04 18:09:37.444542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Aug 04 18:09:37.444707 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444560    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Aug 04 18:09:37.444707 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444634    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Aug 04 18:09:37.444808 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.444867 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-metrics-certs\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.444941 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.444916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg52s\" (UniqueName: \"kubernetes.io/projected/7264abcb-8425-4404-9164-6e30027dbf64-kube-api-access-lg52s\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.446177 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.446159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-59frw"]
Aug 04 18:09:37.545483 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.545455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg52s\" (UniqueName: \"kubernetes.io/projected/7264abcb-8425-4404-9164-6e30027dbf64-kube-api-access-lg52s\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.545630 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.545498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.545630 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.545516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-metrics-certs\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.545630 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:09:37.545617    2580 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 04 18:09:37.545803 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:09:37.545696    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert podName:7264abcb-8425-4404-9164-6e30027dbf64 nodeName:}" failed. No retries permitted until 2026-08-04 18:09:38.045674884 +0000 UTC m=+520.487827170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert") pod "odh-model-controller-8588677cfb-59frw" (UID: "7264abcb-8425-4404-9164-6e30027dbf64") : secret "odh-model-controller-webhook-cert" not found
Aug 04 18:09:37.547804 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.547787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-metrics-certs\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:37.559499 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:37.559469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg52s\" (UniqueName: \"kubernetes.io/projected/7264abcb-8425-4404-9164-6e30027dbf64-kube-api-access-lg52s\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:38.048816 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:38.048779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:38.051105 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:38.051081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7264abcb-8425-4404-9164-6e30027dbf64-cert\") pod \"odh-model-controller-8588677cfb-59frw\" (UID: \"7264abcb-8425-4404-9164-6e30027dbf64\") " pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:38.327814 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:38.327731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:38.457989 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:38.457966    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-8588677cfb-59frw"]
Aug 04 18:09:38.460715 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:09:38.460680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7264abcb_8425_4404_9164_6e30027dbf64.slice/crio-f9964d921a31c400c9eaeb97f473b04375693f99feefa3e093e3544901aea2e6 WatchSource:0}: Error finding container f9964d921a31c400c9eaeb97f473b04375693f99feefa3e093e3544901aea2e6: Status 404 returned error can't find the container with id f9964d921a31c400c9eaeb97f473b04375693f99feefa3e093e3544901aea2e6
Aug 04 18:09:38.461996 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:38.461980    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:09:39.358999 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:39.358954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-59frw" event={"ID":"7264abcb-8425-4404-9164-6e30027dbf64","Type":"ContainerStarted","Data":"f9964d921a31c400c9eaeb97f473b04375693f99feefa3e093e3544901aea2e6"}
Aug 04 18:09:41.369462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:41.369431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-8588677cfb-59frw" event={"ID":"7264abcb-8425-4404-9164-6e30027dbf64","Type":"ContainerStarted","Data":"c1290d09dc020c4f57e2c5d2c1eaad5b4036bd798d22bd984448e7b5b3badd12"}
Aug 04 18:09:41.369840 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:41.369510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:41.388254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:41.388208    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-8588677cfb-59frw" podStartSLOduration=1.597054953 podStartE2EDuration="4.38819196s" totalImagesPullingTime="2.791137007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:09:41.387414283 +0000 UTC m=+523.829566572" watchObservedRunningTime="2026-08-04 18:09:41.38819196 +0000 UTC m=+523.830344282"
Aug 04 18:09:52.375260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:52.375189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-8588677cfb-59frw"
Aug 04 18:09:53.258990 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.258956    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-6f9qw"]
Aug 04 18:09:53.262514 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.262498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.265379 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.265349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Aug 04 18:09:53.265507 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.265384    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-wl8tr\""
Aug 04 18:09:53.271752 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.271728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6f9qw"]
Aug 04 18:09:53.401001 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.400968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjgf\" (UniqueName: \"kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.401363 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.401019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.501904 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.501849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjgf\" (UniqueName: \"kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.502087 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.502016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.502380 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.502363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.512353 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.512292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjgf\" (UniqueName: \"kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf\") pod \"s3-init-6f9qw\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") " pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.584562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.584526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6f9qw"
Aug 04 18:09:53.712132 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:53.712106    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6f9qw"]
Aug 04 18:09:53.714393 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:09:53.714368    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7784a43a_0510_4dc0_8938_492fcf752eda.slice/crio-b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e WatchSource:0}: Error finding container b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e: Status 404 returned error can't find the container with id b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e
Aug 04 18:09:54.426326 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:54.426283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerStarted","Data":"b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e"}
Aug 04 18:09:57.440409 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:57.440375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerStarted","Data":"8476e0d435645a265e5445f243d8fa95aa84613e0f06dc4fe65016bb041c572a"}
Aug 04 18:09:59.450352 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:59.450317    2580 generic.go:356] "Generic (PLEG): container finished" podID="7784a43a-0510-4dc0-8938-492fcf752eda" containerID="8476e0d435645a265e5445f243d8fa95aa84613e0f06dc4fe65016bb041c572a" exitCode=0
Aug 04 18:09:59.450842 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:09:59.450393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerDied","Data":"8476e0d435645a265e5445f243d8fa95aa84613e0f06dc4fe65016bb041c572a"}
Aug 04 18:10:03.785201 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:10:03.785179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Aug 04 18:10:04.475384 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:10:04.475352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerStarted","Data":"e5c95453cdf45780b70cd5eda2cc525f9f225c5b07a357fe3d78195fbf616df7"}
Aug 04 18:10:04.492909 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:10:04.492849    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-6f9qw" podStartSLOduration=2.255219241 podStartE2EDuration="11.492835834s" totalImagesPullingTime="7.718669445s" totalInitContainerRuntime="1.518947148s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:09:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:10:04.491739077 +0000 UTC m=+546.933891370" watchObservedRunningTime="2026-08-04 18:10:04.492835834 +0000 UTC m=+546.934988177"
Aug 04 18:11:08.734334 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:08.734305    2580 generic.go:356] "Generic (PLEG): container finished" podID="7784a43a-0510-4dc0-8938-492fcf752eda" containerID="e5c95453cdf45780b70cd5eda2cc525f9f225c5b07a357fe3d78195fbf616df7" exitCode=0
Aug 04 18:11:08.734712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:08.734376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerDied","Data":"e5c95453cdf45780b70cd5eda2cc525f9f225c5b07a357fe3d78195fbf616df7"}
Aug 04 18:11:09.860865 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:09.860836    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6f9qw"
Aug 04 18:11:10.040704 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.040600    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdjgf\" (UniqueName: \"kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf\") pod \"7784a43a-0510-4dc0-8938-492fcf752eda\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") "
Aug 04 18:11:10.040704 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.040707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache\") pod \"7784a43a-0510-4dc0-8938-492fcf752eda\" (UID: \"7784a43a-0510-4dc0-8938-492fcf752eda\") "
Aug 04 18:11:10.042869 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.042832    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf" (OuterVolumeSpecName: "kube-api-access-kdjgf") pod "7784a43a-0510-4dc0-8938-492fcf752eda" (UID: "7784a43a-0510-4dc0-8938-492fcf752eda"). InnerVolumeSpecName "kube-api-access-kdjgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:11:10.060169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.060138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache" (OuterVolumeSpecName: "model-cache") pod "7784a43a-0510-4dc0-8938-492fcf752eda" (UID: "7784a43a-0510-4dc0-8938-492fcf752eda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:11:10.141805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.141762    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdjgf\" (UniqueName: \"kubernetes.io/projected/7784a43a-0510-4dc0-8938-492fcf752eda-kube-api-access-kdjgf\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:11:10.141805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.141799    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7784a43a-0510-4dc0-8938-492fcf752eda-model-cache\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:11:10.743768 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.743741    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6f9qw"
Aug 04 18:11:10.743768 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.743762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6f9qw" event={"ID":"7784a43a-0510-4dc0-8938-492fcf752eda","Type":"ContainerDied","Data":"b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e"}
Aug 04 18:11:10.744016 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:10.743794    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b16b1249a5fb89d964d3ec0a107b267a0d3a381a405e42ec0a3870646d05970e"
Aug 04 18:11:24.464139 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464064    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:11:24.464546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464420    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7784a43a-0510-4dc0-8938-492fcf752eda" containerName="download-hf-model"
Aug 04 18:11:24.464546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464430    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7784a43a-0510-4dc0-8938-492fcf752eda" containerName="download-hf-model"
Aug 04 18:11:24.464546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464443    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7784a43a-0510-4dc0-8938-492fcf752eda" containerName="s3-init"
Aug 04 18:11:24.464546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464450    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7784a43a-0510-4dc0-8938-492fcf752eda" containerName="s3-init"
Aug 04 18:11:24.464546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.464503    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7784a43a-0510-4dc0-8938-492fcf752eda" containerName="s3-init"
Aug 04 18:11:24.467439 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.467423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.470250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.470227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 04 18:11:24.470361 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.470322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64gfv\""
Aug 04 18:11:24.470361 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.470332    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Aug 04 18:11:24.471495 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.471478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Aug 04 18:11:24.471597 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.471532    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Aug 04 18:11:24.471597 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.471549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Aug 04 18:11:24.471597 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.471554    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Aug 04 18:11:24.479568 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.479546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:11:24.572830 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.572797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.573001 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.572874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.573001 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.572918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.573001 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.572973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.573109 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.573010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nwmn\" (UniqueName: \"kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.662560 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.662527    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:11:24.665966 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.665947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.668638 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.668618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Aug 04 18:11:24.668774 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.668704    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Aug 04 18:11:24.673447 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.673545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.673545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.673545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nwmn\" (UniqueName: \"kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.673692 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.673692 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:11:24.673605    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Aug 04 18:11:24.673692 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:11:24.673675    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls podName:7479b599-f118-470b-82d6-10e7e1dd85ac nodeName:}" failed. No retries permitted until 2026-08-04 18:11:25.173655874 +0000 UTC m=+627.615808156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls") pod "isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Aug 04 18:11:24.673917 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.673875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.674330 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.674309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.674372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.674309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.680039 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.680017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:11:24.687805 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.687784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nwmn\" (UniqueName: \"kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:24.763838 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.763774    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:11:24.767361 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.767346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.770226 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.770207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Aug 04 18:11:24.770339 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.770250    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Aug 04 18:11:24.774106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.773994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.774106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.774032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.774106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.774068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.774332 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.774189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87dsf\" (UniqueName: \"kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.774332 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.774212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.778704 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.778684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:11:24.874619 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.874778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhx8b\" (UniqueName: \"kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.874778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.874778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.874778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.874778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.875043 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dsf\" (UniqueName: \"kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.875043 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.875043 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.874987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.875043 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.875038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.875262 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.875090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.875383 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.875362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.875572 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.875554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.877187 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.877149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.884823 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.884803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87dsf\" (UniqueName: \"kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf\") pod \"isvc-xgboost-graph-predictor-555fc69d56-2nfrt\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.975748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.975985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.975985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.975985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:11:24.975985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhx8b\" (UniqueName: \"kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.975985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.975863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.976296 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.976276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.976436 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.976417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.976503 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.976482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.978183 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.978164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:24.989808 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:24.989779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhx8b\" (UniqueName: \"kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b\") pod \"isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:25.077546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.077515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:11:25.116395 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.116373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:11:25.118928 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:11:25.118878    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-3e3e3111f56f077887d2f4ce1112fa4a2cbd70be61894a533ce489d3d97ad000 WatchSource:0}: Error finding container 3e3e3111f56f077887d2f4ce1112fa4a2cbd70be61894a533ce489d3d97ad000: Status 404 returned error can't find the container with id 3e3e3111f56f077887d2f4ce1112fa4a2cbd70be61894a533ce489d3d97ad000
Aug 04 18:11:25.177504 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.177474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:25.180109 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.180081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:25.222033 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.222010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:11:25.224068 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:11:25.224041    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83854529_24de_4399_8b8e_5d0a37e14ceb.slice/crio-c7418aac60e2a26281f5beb88907218a41809536d08b9aed82e683797259e873 WatchSource:0}: Error finding container c7418aac60e2a26281f5beb88907218a41809536d08b9aed82e683797259e873: Status 404 returned error can't find the container with id c7418aac60e2a26281f5beb88907218a41809536d08b9aed82e683797259e873
Aug 04 18:11:25.378370 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.378331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:11:25.534109 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.534084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:11:25.536321 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:11:25.536297    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7479b599_f118_470b_82d6_10e7e1dd85ac.slice/crio-bce4aa5aff23ca69aaaae34b632a0d3b73ed8a205d079eca7df1a9099c12474c WatchSource:0}: Error finding container bce4aa5aff23ca69aaaae34b632a0d3b73ed8a205d079eca7df1a9099c12474c: Status 404 returned error can't find the container with id bce4aa5aff23ca69aaaae34b632a0d3b73ed8a205d079eca7df1a9099c12474c
Aug 04 18:11:25.805746 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.805646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerStarted","Data":"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"}
Aug 04 18:11:25.805746 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.805731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerStarted","Data":"c7418aac60e2a26281f5beb88907218a41809536d08b9aed82e683797259e873"}
Aug 04 18:11:25.807351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.807317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerStarted","Data":"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"}
Aug 04 18:11:25.807498 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.807387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerStarted","Data":"bce4aa5aff23ca69aaaae34b632a0d3b73ed8a205d079eca7df1a9099c12474c"}
Aug 04 18:11:25.808911 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.808876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerStarted","Data":"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"}
Aug 04 18:11:25.809007 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:25.808942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerStarted","Data":"3e3e3111f56f077887d2f4ce1112fa4a2cbd70be61894a533ce489d3d97ad000"}
Aug 04 18:11:29.827917 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.827809    2580 generic.go:356] "Generic (PLEG): container finished" podID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerID="e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3" exitCode=0
Aug 04 18:11:29.827917 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.827884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerDied","Data":"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"}
Aug 04 18:11:29.829684 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.829631    2580 generic.go:356] "Generic (PLEG): container finished" podID="e235e88c-71be-4504-b746-2a44923f1d32" containerID="17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120" exitCode=0
Aug 04 18:11:29.829756 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.829702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerDied","Data":"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"}
Aug 04 18:11:29.831295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.831272    2580 generic.go:356] "Generic (PLEG): container finished" podID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerID="1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf" exitCode=0
Aug 04 18:11:29.831420 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:29.831356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerDied","Data":"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"}
Aug 04 18:11:58.052821 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:58.052788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerStarted","Data":"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"}
Aug 04 18:11:58.054515 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:58.054490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerStarted","Data":"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"}
Aug 04 18:11:59.064330 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:11:59.064283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerStarted","Data":"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"}
Aug 04 18:12:02.088725 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.088687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerStarted","Data":"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"}
Aug 04 18:12:02.089199 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.088982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:12:02.089199 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.089044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:12:02.090494 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.090459    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:02.090936 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.090911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerStarted","Data":"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"}
Aug 04 18:12:02.091010 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.090976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:12:02.091061 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.091011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:12:02.092169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.092142    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:02.092970 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.092949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerStarted","Data":"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"}
Aug 04 18:12:02.093156 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.093141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:12:02.093208 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.093183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:12:02.094082 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.094059    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:02.129768 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.129706    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podStartSLOduration=3.146201115 podStartE2EDuration="38.129683239s" totalImagesPullingTime="31.340258281s" totalInitContainerRuntime="3.643223843s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:02.128914432 +0000 UTC m=+664.571066725" watchObservedRunningTime="2026-08-04 18:12:02.129683239 +0000 UTC m=+664.571835530"
Aug 04 18:12:02.167116 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.167063    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podStartSLOduration=3.246093537 podStartE2EDuration="38.167041378s" totalImagesPullingTime="31.258572038s" totalInitContainerRuntime="3.662375803s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:02.165530135 +0000 UTC m=+664.607682426" watchObservedRunningTime="2026-08-04 18:12:02.167041378 +0000 UTC m=+664.609193671"
Aug 04 18:12:02.201948 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:02.201901    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podStartSLOduration=3.084500679 podStartE2EDuration="38.201874033s" totalImagesPullingTime="31.239705381s" totalInitContainerRuntime="3.877667973s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:02.199063176 +0000 UTC m=+664.641215467" watchObservedRunningTime="2026-08-04 18:12:02.201874033 +0000 UTC m=+664.644026324"
Aug 04 18:12:03.097699 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.097664    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:03.098185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.097665    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:03.098185 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.097664    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:03.309366 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.309336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644fcc4454-d8swm"]
Aug 04 18:12:03.312612 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.312593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.330627 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.330599    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644fcc4454-d8swm"]
Aug 04 18:12:03.362473 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-oauth-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362473 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-trusted-ca-bundle\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362606 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-oauth-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362606 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-console-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362675 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtrd\" (UniqueName: \"kubernetes.io/projected/d961718b-664b-49e0-9bbb-ef0003fd2472-kube-api-access-7dtrd\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362675 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.362675 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.362654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-service-ca\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463382 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463382 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-service-ca\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-oauth-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-trusted-ca-bundle\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-oauth-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-console-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.463768 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.463605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtrd\" (UniqueName: \"kubernetes.io/projected/d961718b-664b-49e0-9bbb-ef0003fd2472-kube-api-access-7dtrd\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.464323 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.464300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-console-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.464438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.464333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-oauth-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.464438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.464341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-service-ca\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.464581 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.464560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d961718b-664b-49e0-9bbb-ef0003fd2472-trusted-ca-bundle\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.465829 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.465804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-oauth-config\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.465829 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.465818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d961718b-664b-49e0-9bbb-ef0003fd2472-console-serving-cert\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.475797 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.475779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtrd\" (UniqueName: \"kubernetes.io/projected/d961718b-664b-49e0-9bbb-ef0003fd2472-kube-api-access-7dtrd\") pod \"console-644fcc4454-d8swm\" (UID: \"d961718b-664b-49e0-9bbb-ef0003fd2472\") " pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.622214 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.622138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:03.759088 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:03.759065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644fcc4454-d8swm"]
Aug 04 18:12:03.760936 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:12:03.760913    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd961718b_664b_49e0_9bbb_ef0003fd2472.slice/crio-9cc44388b39649c7bb2fb1d27a6ab5f951a45859d56db71c7550ddfdb9becd04 WatchSource:0}: Error finding container 9cc44388b39649c7bb2fb1d27a6ab5f951a45859d56db71c7550ddfdb9becd04: Status 404 returned error can't find the container with id 9cc44388b39649c7bb2fb1d27a6ab5f951a45859d56db71c7550ddfdb9becd04
Aug 04 18:12:04.103079 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:04.103047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644fcc4454-d8swm" event={"ID":"d961718b-664b-49e0-9bbb-ef0003fd2472","Type":"ContainerStarted","Data":"1a1973bb57e379d737918e786fc8c61a313dfb31a82eafd590adea93a6f8c724"}
Aug 04 18:12:04.103450 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:04.103093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644fcc4454-d8swm" event={"ID":"d961718b-664b-49e0-9bbb-ef0003fd2472","Type":"ContainerStarted","Data":"9cc44388b39649c7bb2fb1d27a6ab5f951a45859d56db71c7550ddfdb9becd04"}
Aug 04 18:12:04.128119 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:04.128054    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644fcc4454-d8swm" podStartSLOduration=1.128038611 podStartE2EDuration="1.128038611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:04.126293234 +0000 UTC m=+666.568445528" watchObservedRunningTime="2026-08-04 18:12:04.128038611 +0000 UTC m=+666.570190902"
Aug 04 18:12:08.101592 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.101563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:12:08.102137 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.102106    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:08.102617 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.102596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:12:08.102698 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.102670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:12:08.103064 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.103042    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:08.103126 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:08.103066    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:13.622712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:13.622672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:13.623213 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:13.622734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:13.629262 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:13.629233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:14.159214 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:14.159186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644fcc4454-d8swm"
Aug 04 18:12:14.212632 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:14.212604    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:12:18.102305 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:18.102266    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:18.103207 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:18.103177    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:18.103352 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:18.103198    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:28.103216 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:28.102803    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:28.104315 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:28.103228    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:28.104534 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:28.103405    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:38.101969 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:38.101926    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:38.103094 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:38.103066    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:38.103202 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:38.103066    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:39.236673 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.236630    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dfc7d8594-zvfcs" podUID="8a175164-374e-4548-808c-ff5e6f8ee1c8" containerName="console" containerID="cri-o://34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8" gracePeriod=15
Aug 04 18:12:39.475182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.475157    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:12:39.600412 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600333    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600412 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600393    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600460    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600525    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600657 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7zsh\" (UniqueName: \"kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh\") pod \"8a175164-374e-4548-808c-ff5e6f8ee1c8\" (UID: \"8a175164-374e-4548-808c-ff5e6f8ee1c8\") "
Aug 04 18:12:39.600971 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:12:39.600971 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600845    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:12:39.600971 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config" (OuterVolumeSpecName: "console-config") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:12:39.601114 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.600988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:12:39.602675 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.602636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:12:39.602788 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.602687    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:12:39.602788 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.602697    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh" (OuterVolumeSpecName: "kube-api-access-j7zsh") pod "8a175164-374e-4548-808c-ff5e6f8ee1c8" (UID: "8a175164-374e-4548-808c-ff5e6f8ee1c8"). InnerVolumeSpecName "kube-api-access-j7zsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:12:39.701281 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701255    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-service-ca\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701281 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701279    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701288    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-oauth-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701298    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-trusted-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701307    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a175164-374e-4548-808c-ff5e6f8ee1c8-console-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701315    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a175164-374e-4548-808c-ff5e6f8ee1c8-oauth-serving-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:39.701451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:39.701323    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7zsh\" (UniqueName: \"kubernetes.io/projected/8a175164-374e-4548-808c-ff5e6f8ee1c8-kube-api-access-j7zsh\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:12:40.278117 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.278080    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a175164-374e-4548-808c-ff5e6f8ee1c8" containerID="34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8" exitCode=0
Aug 04 18:12:40.278502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.278147    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfc7d8594-zvfcs"
Aug 04 18:12:40.278502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.278162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfc7d8594-zvfcs" event={"ID":"8a175164-374e-4548-808c-ff5e6f8ee1c8","Type":"ContainerDied","Data":"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"}
Aug 04 18:12:40.278502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.278217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfc7d8594-zvfcs" event={"ID":"8a175164-374e-4548-808c-ff5e6f8ee1c8","Type":"ContainerDied","Data":"640eb94f290121920a48211fa03718109e7b02f15cce6d10f6329659285469da"}
Aug 04 18:12:40.278502 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.278241    2580 scope.go:117] "RemoveContainer" containerID="34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"
Aug 04 18:12:40.286557 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.286528    2580 scope.go:117] "RemoveContainer" containerID="34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"
Aug 04 18:12:40.286786 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:12:40.286768    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8\": container with ID starting with 34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8 not found: ID does not exist" containerID="34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"
Aug 04 18:12:40.286839 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.286794    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8"} err="failed to get container status \"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8\": rpc error: code = NotFound desc = could not find container \"34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8\": container with ID starting with 34533acfda4afd71502c4ed5851e96a8a8c1df7c602dca09e680ca2b00b819f8 not found: ID does not exist"
Aug 04 18:12:40.298297 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.298274    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:12:40.302492 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:40.302471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dfc7d8594-zvfcs"]
Aug 04 18:12:42.146316 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:42.146283    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a175164-374e-4548-808c-ff5e6f8ee1c8" path="/var/lib/kubelet/pods/8a175164-374e-4548-808c-ff5e6f8ee1c8/volumes"
Aug 04 18:12:48.102023 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:48.101985    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:48.103225 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:48.103195    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:12:48.103225 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:48.103208    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:58.102488 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:58.102455    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:12:58.103052 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:58.103025    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:12:58.103138 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:12:58.103027    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:13:08.102481 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:08.102441    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:13:08.103663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:08.103636    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:13:08.104021 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:08.104007    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:13:18.102585 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:18.102556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:13:18.103699 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:18.103676    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:13:54.456528 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.456494    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:13:54.457187 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.456797    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" containerID="cri-o://7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed" gracePeriod=30
Aug 04 18:13:54.457187 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.456907    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kube-rbac-proxy" containerID="cri-o://b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72" gracePeriod=30
Aug 04 18:13:54.510795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.510769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:13:54.511042 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.511020    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" containerID="cri-o://e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175" gracePeriod=30
Aug 04 18:13:54.511141 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.511113    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kube-rbac-proxy" containerID="cri-o://e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5" gracePeriod=30
Aug 04 18:13:54.561734 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.561707    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:13:54.561995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.561965    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" containerID="cri-o://eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552" gracePeriod=30
Aug 04 18:13:54.561995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.561977    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kube-rbac-proxy" containerID="cri-o://89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832" gracePeriod=30
Aug 04 18:13:54.600676 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.600648    2580 generic.go:356] "Generic (PLEG): container finished" podID="e235e88c-71be-4504-b746-2a44923f1d32" containerID="b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72" exitCode=2
Aug 04 18:13:54.600779 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:54.600727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerDied","Data":"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"}
Aug 04 18:13:55.607163 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:55.607127    2580 generic.go:356] "Generic (PLEG): container finished" podID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerID="e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5" exitCode=2
Aug 04 18:13:55.607562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:55.607200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerDied","Data":"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"}
Aug 04 18:13:55.609284 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:55.609262    2580 generic.go:356] "Generic (PLEG): container finished" podID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerID="89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832" exitCode=2
Aug 04 18:13:55.609392 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:55.609332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerDied","Data":"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"}
Aug 04 18:13:58.097684 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.097642    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Aug 04 18:13:58.098110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.097678    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Aug 04 18:13:58.098110 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.097679    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Aug 04 18:13:58.102378 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.102345    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Aug 04 18:13:58.103583 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.103559    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 04 18:13:58.103714 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.103596    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 04 18:13:58.202223 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.202195    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:13:58.301378 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301290    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87dsf\" (UniqueName: \"kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf\") pod \"e235e88c-71be-4504-b746-2a44923f1d32\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") "
Aug 04 18:13:58.301378 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location\") pod \"e235e88c-71be-4504-b746-2a44923f1d32\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") "
Aug 04 18:13:58.301378 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301360    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert\") pod \"e235e88c-71be-4504-b746-2a44923f1d32\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") "
Aug 04 18:13:58.301631 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config\") pod \"e235e88c-71be-4504-b746-2a44923f1d32\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") "
Aug 04 18:13:58.301631 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301445    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls\") pod \"e235e88c-71be-4504-b746-2a44923f1d32\" (UID: \"e235e88c-71be-4504-b746-2a44923f1d32\") "
Aug 04 18:13:58.301723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e235e88c-71be-4504-b746-2a44923f1d32" (UID: "e235e88c-71be-4504-b746-2a44923f1d32"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:58.301790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301759    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e235e88c-71be-4504-b746-2a44923f1d32" (UID: "e235e88c-71be-4504-b746-2a44923f1d32"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:58.301790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301770    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e235e88c-71be-4504-b746-2a44923f1d32-kserve-provision-location\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:58.301790 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.301772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e235e88c-71be-4504-b746-2a44923f1d32" (UID: "e235e88c-71be-4504-b746-2a44923f1d32"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:58.303568 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.303547    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e235e88c-71be-4504-b746-2a44923f1d32" (UID: "e235e88c-71be-4504-b746-2a44923f1d32"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:58.303568 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.303552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf" (OuterVolumeSpecName: "kube-api-access-87dsf") pod "e235e88c-71be-4504-b746-2a44923f1d32" (UID: "e235e88c-71be-4504-b746-2a44923f1d32"). InnerVolumeSpecName "kube-api-access-87dsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:58.402415 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.402375    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87dsf\" (UniqueName: \"kubernetes.io/projected/e235e88c-71be-4504-b746-2a44923f1d32-kube-api-access-87dsf\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:58.402415 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.402409    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-cabundle-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:58.402415 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.402423    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e235e88c-71be-4504-b746-2a44923f1d32-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:58.402649 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.402435    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e235e88c-71be-4504-b746-2a44923f1d32-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:58.623577 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.623483    2580 generic.go:356] "Generic (PLEG): container finished" podID="e235e88c-71be-4504-b746-2a44923f1d32" containerID="7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed" exitCode=0
Aug 04 18:13:58.623577 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.623539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerDied","Data":"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"}
Aug 04 18:13:58.623577 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.623547    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"
Aug 04 18:13:58.623841 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.623603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt" event={"ID":"e235e88c-71be-4504-b746-2a44923f1d32","Type":"ContainerDied","Data":"3e3e3111f56f077887d2f4ce1112fa4a2cbd70be61894a533ce489d3d97ad000"}
Aug 04 18:13:58.623841 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.623643    2580 scope.go:117] "RemoveContainer" containerID="b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"
Aug 04 18:13:58.633718 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.633696    2580 scope.go:117] "RemoveContainer" containerID="7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"
Aug 04 18:13:58.641034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.641013    2580 scope.go:117] "RemoveContainer" containerID="17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"
Aug 04 18:13:58.648408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.648385    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:13:58.648836 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.648823    2580 scope.go:117] "RemoveContainer" containerID="b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"
Aug 04 18:13:58.649109 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:58.649092    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72\": container with ID starting with b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72 not found: ID does not exist" containerID="b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"
Aug 04 18:13:58.649144 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.649122    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72"} err="failed to get container status \"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72\": rpc error: code = NotFound desc = could not find container \"b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72\": container with ID starting with b8a984a59daeadfb2eaf6675233de9b2142758ea62ab0ca20b529c7c0518ff72 not found: ID does not exist"
Aug 04 18:13:58.649187 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.649144    2580 scope.go:117] "RemoveContainer" containerID="7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"
Aug 04 18:13:58.649367 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:58.649350    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed\": container with ID starting with 7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed not found: ID does not exist" containerID="7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"
Aug 04 18:13:58.649402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.649372    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed"} err="failed to get container status \"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed\": rpc error: code = NotFound desc = could not find container \"7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed\": container with ID starting with 7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed not found: ID does not exist"
Aug 04 18:13:58.649402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.649386    2580 scope.go:117] "RemoveContainer" containerID="17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"
Aug 04 18:13:58.649645 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:58.649592    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120\": container with ID starting with 17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120 not found: ID does not exist" containerID="17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"
Aug 04 18:13:58.649645 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.649614    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120"} err="failed to get container status \"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120\": rpc error: code = NotFound desc = could not find container \"17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120\": container with ID starting with 17094ad99bb846d5a10eefc189ba5baeb4a881221ddd5aedd596f2d80ccbe120 not found: ID does not exist"
Aug 04 18:13:58.652138 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:58.652116    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-2nfrt"]
Aug 04 18:13:59.474496 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.474449    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:13:59.477230 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.477214    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:13:59.512099 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config\") pod \"83854529-24de-4399-8b8e-5d0a37e14ceb\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") "
Aug 04 18:13:59.512241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512125    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config\") pod \"7479b599-f118-470b-82d6-10e7e1dd85ac\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") "
Aug 04 18:13:59.512241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512158    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhx8b\" (UniqueName: \"kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b\") pod \"83854529-24de-4399-8b8e-5d0a37e14ceb\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") "
Aug 04 18:13:59.512241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert\") pod \"83854529-24de-4399-8b8e-5d0a37e14ceb\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") "
Aug 04 18:13:59.512241 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") pod \"7479b599-f118-470b-82d6-10e7e1dd85ac\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") "
Aug 04 18:13:59.512462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls\") pod \"83854529-24de-4399-8b8e-5d0a37e14ceb\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") "
Aug 04 18:13:59.512462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512319    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location\") pod \"7479b599-f118-470b-82d6-10e7e1dd85ac\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") "
Aug 04 18:13:59.512462 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert\") pod \"7479b599-f118-470b-82d6-10e7e1dd85ac\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") "
Aug 04 18:13:59.512619 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512457    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "83854529-24de-4399-8b8e-5d0a37e14ceb" (UID: "83854529-24de-4399-8b8e-5d0a37e14ceb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:59.512703 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512665    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7479b599-f118-470b-82d6-10e7e1dd85ac" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:59.512766 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512695    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7479b599-f118-470b-82d6-10e7e1dd85ac" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:59.512766 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nwmn\" (UniqueName: \"kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn\") pod \"7479b599-f118-470b-82d6-10e7e1dd85ac\" (UID: \"7479b599-f118-470b-82d6-10e7e1dd85ac\") "
Aug 04 18:13:59.512881 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "83854529-24de-4399-8b8e-5d0a37e14ceb" (UID: "83854529-24de-4399-8b8e-5d0a37e14ceb"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:59.512881 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location\") pod \"83854529-24de-4399-8b8e-5d0a37e14ceb\" (UID: \"83854529-24de-4399-8b8e-5d0a37e14ceb\") "
Aug 04 18:13:59.512881 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.512873    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7479b599-f118-470b-82d6-10e7e1dd85ac" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:59.513157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513135    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "83854529-24de-4399-8b8e-5d0a37e14ceb" (UID: "83854529-24de-4399-8b8e-5d0a37e14ceb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:59.513305 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513285    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.513372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513309    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-cabundle-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.513372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513324    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7479b599-f118-470b-82d6-10e7e1dd85ac-kserve-provision-location\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.513372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513338    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7479b599-f118-470b-82d6-10e7e1dd85ac-cabundle-cert\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.513372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513352    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83854529-24de-4399-8b8e-5d0a37e14ceb-kserve-provision-location\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.513372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.513365    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.514586 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.514565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7479b599-f118-470b-82d6-10e7e1dd85ac" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:59.514664 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.514609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "83854529-24de-4399-8b8e-5d0a37e14ceb" (UID: "83854529-24de-4399-8b8e-5d0a37e14ceb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:59.514780 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.514755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b" (OuterVolumeSpecName: "kube-api-access-xhx8b") pod "83854529-24de-4399-8b8e-5d0a37e14ceb" (UID: "83854529-24de-4399-8b8e-5d0a37e14ceb"). InnerVolumeSpecName "kube-api-access-xhx8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:59.515089 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.515065    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn" (OuterVolumeSpecName: "kube-api-access-6nwmn") pod "7479b599-f118-470b-82d6-10e7e1dd85ac" (UID: "7479b599-f118-470b-82d6-10e7e1dd85ac"). InnerVolumeSpecName "kube-api-access-6nwmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:59.614620 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.614587    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nwmn\" (UniqueName: \"kubernetes.io/projected/7479b599-f118-470b-82d6-10e7e1dd85ac-kube-api-access-6nwmn\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.614620 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.614620    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhx8b\" (UniqueName: \"kubernetes.io/projected/83854529-24de-4399-8b8e-5d0a37e14ceb-kube-api-access-xhx8b\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.614825 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.614635    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7479b599-f118-470b-82d6-10e7e1dd85ac-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.614825 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.614646    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83854529-24de-4399-8b8e-5d0a37e14ceb-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:13:59.630215 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.630189    2580 generic.go:356] "Generic (PLEG): container finished" podID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerID="eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552" exitCode=0
Aug 04 18:13:59.630357 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.630254    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"
Aug 04 18:13:59.630357 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.630280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerDied","Data":"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"}
Aug 04 18:13:59.630357 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.630346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh" event={"ID":"7479b599-f118-470b-82d6-10e7e1dd85ac","Type":"ContainerDied","Data":"bce4aa5aff23ca69aaaae34b632a0d3b73ed8a205d079eca7df1a9099c12474c"}
Aug 04 18:13:59.630512 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.630387    2580 scope.go:117] "RemoveContainer" containerID="89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"
Aug 04 18:13:59.633644 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.633615    2580 generic.go:356] "Generic (PLEG): container finished" podID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerID="e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175" exitCode=0
Aug 04 18:13:59.633770 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.633684    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"
Aug 04 18:13:59.633770 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.633698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerDied","Data":"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"}
Aug 04 18:13:59.633770 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.633753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn" event={"ID":"83854529-24de-4399-8b8e-5d0a37e14ceb","Type":"ContainerDied","Data":"c7418aac60e2a26281f5beb88907218a41809536d08b9aed82e683797259e873"}
Aug 04 18:13:59.641920 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.641863    2580 scope.go:117] "RemoveContainer" containerID="eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"
Aug 04 18:13:59.650704 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.650687    2580 scope.go:117] "RemoveContainer" containerID="e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"
Aug 04 18:13:59.658759 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.658735    2580 scope.go:117] "RemoveContainer" containerID="89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"
Aug 04 18:13:59.659032 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.659014    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832\": container with ID starting with 89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832 not found: ID does not exist" containerID="89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"
Aug 04 18:13:59.659124 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659039    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832"} err="failed to get container status \"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832\": rpc error: code = NotFound desc = could not find container \"89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832\": container with ID starting with 89b68eaa91539b3fb69c32e40f4c4872791d35b49969e3b85dcbf578611aa832 not found: ID does not exist"
Aug 04 18:13:59.659124 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659057    2580 scope.go:117] "RemoveContainer" containerID="eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"
Aug 04 18:13:59.659254 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659239    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:13:59.659304 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.659289    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552\": container with ID starting with eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552 not found: ID does not exist" containerID="eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"
Aug 04 18:13:59.659346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659309    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552"} err="failed to get container status \"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552\": rpc error: code = NotFound desc = could not find container \"eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552\": container with ID starting with eb6832b5dac79bb06624913267787db28213c9eb44a7f54d3d2a8a814cc7b552 not found: ID does not exist"
Aug 04 18:13:59.659346 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659326    2580 scope.go:117] "RemoveContainer" containerID="e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"
Aug 04 18:13:59.659980 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.659691    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3\": container with ID starting with e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3 not found: ID does not exist" containerID="e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"
Aug 04 18:13:59.659980 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659719    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3"} err="failed to get container status \"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3\": rpc error: code = NotFound desc = could not find container \"e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3\": container with ID starting with e6741680f6e48bbb9045728f642935c236d00b246f6ee94f24f20a5693fe5ed3 not found: ID does not exist"
Aug 04 18:13:59.659980 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.659740    2580 scope.go:117] "RemoveContainer" containerID="e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"
Aug 04 18:13:59.662113 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.662094    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6ff6c549bd-2xhvh"]
Aug 04 18:13:59.666900 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.666874    2580 scope.go:117] "RemoveContainer" containerID="e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"
Aug 04 18:13:59.673837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.673819    2580 scope.go:117] "RemoveContainer" containerID="1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"
Aug 04 18:13:59.674019 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.674002    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:13:59.680630 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.680589    2580 scope.go:117] "RemoveContainer" containerID="e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"
Aug 04 18:13:59.680865 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.680848    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5\": container with ID starting with e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5 not found: ID does not exist" containerID="e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"
Aug 04 18:13:59.680965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.680870    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5"} err="failed to get container status \"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5\": rpc error: code = NotFound desc = could not find container \"e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5\": container with ID starting with e9285f35f8ec6a700ee27adff25d16b95fc08f7ef78b7d3bd9c6ba6844cab5d5 not found: ID does not exist"
Aug 04 18:13:59.680965 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.680901    2580 scope.go:117] "RemoveContainer" containerID="e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"
Aug 04 18:13:59.681148 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.681127    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175\": container with ID starting with e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175 not found: ID does not exist" containerID="e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"
Aug 04 18:13:59.681218 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.681152    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175"} err="failed to get container status \"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175\": rpc error: code = NotFound desc = could not find container \"e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175\": container with ID starting with e150f862345ad1f9c89087631d6ad7a4b23e41f5b0f4a931cef363abe8edb175 not found: ID does not exist"
Aug 04 18:13:59.681218 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.681168    2580 scope.go:117] "RemoveContainer" containerID="1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"
Aug 04 18:13:59.681425 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:13:59.681409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf\": container with ID starting with 1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf not found: ID does not exist" containerID="1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"
Aug 04 18:13:59.681482 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.681431    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf"} err="failed to get container status \"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf\": rpc error: code = NotFound desc = could not find container \"1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf\": container with ID starting with 1da284b1577e72a46bd3c26894cd4239983e454cdaf9edc41208b71786ba7faf not found: ID does not exist"
Aug 04 18:13:59.683314 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:13:59.683296    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-cf88c5444-mzkmn"]
Aug 04 18:14:00.036513 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:00.036482    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:00.147219 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:00.147182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" path="/var/lib/kubelet/pods/7479b599-f118-470b-82d6-10e7e1dd85ac/volumes"
Aug 04 18:14:00.147662 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:00.147649    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" path="/var/lib/kubelet/pods/83854529-24de-4399-8b8e-5d0a37e14ceb/volumes"
Aug 04 18:14:00.148387 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:00.148373    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e235e88c-71be-4504-b746-2a44923f1d32" path="/var/lib/kubelet/pods/e235e88c-71be-4504-b746-2a44923f1d32/volumes"
Aug 04 18:14:00.257897 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:00.257849    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:10.076239 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:10.076209    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:15.247845 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:15.247809    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:20.118340 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:20.118265    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:24.835609 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:24.835572    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:24.836003 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:24.835793    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:30.161573 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:30.161540    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:30.240902 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:30.240850    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:40.203786 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:40.203750    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:45.289077 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:45.289036    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:50.211512 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:50.211476    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235e88c_71be_4504_b746_2a44923f1d32.slice/crio-7c637de2dcfa9024ea721eac3640fd0b85cd6bcf88be32250af67c55e8ad2eed.scope\": RecentStats: unable to find data in memory cache]"
Aug 04 18:14:54.588691 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.588655    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:14:54.589075 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589064    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589077    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589088    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589093    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589103    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="storage-initializer"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589108    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="storage-initializer"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589114    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589119    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589130    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589142    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a175164-374e-4548-808c-ff5e6f8ee1c8" containerName="console"
Aug 04 18:14:54.589151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589147    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a175164-374e-4548-808c-ff5e6f8ee1c8" containerName="console"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589156    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589163    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589171    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="storage-initializer"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589176    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="storage-initializer"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589183    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="storage-initializer"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589187    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="storage-initializer"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589194    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589199    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589245    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589254    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a175164-374e-4548-808c-ff5e6f8ee1c8" containerName="console"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589260    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479b599-f118-470b-82d6-10e7e1dd85ac" containerName="kserve-container"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589266    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kserve-container"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589271    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kserve-container"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589277    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e235e88c-71be-4504-b746-2a44923f1d32" containerName="kube-rbac-proxy"
Aug 04 18:14:54.589518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.589282    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83854529-24de-4399-8b8e-5d0a37e14ceb" containerName="kube-rbac-proxy"
Aug 04 18:14:54.592103 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.592088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:54.594618 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.594597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-315c2-serving-cert\""
Aug 04 18:14:54.594925 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.594900    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-315c2-kube-rbac-proxy-sar-config\""
Aug 04 18:14:54.595033 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.594933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 04 18:14:54.595083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.595053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64gfv\""
Aug 04 18:14:54.603047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.603029    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:14:54.681580 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.681551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:54.681745 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.681591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:54.782883 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.782843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:54.783070 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.782918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:54.783070 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:54.783016    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-315c2-serving-cert: secret "sequence-graph-315c2-serving-cert" not found
Aug 04 18:14:54.783146 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:14:54.783090    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls podName:4e6789d1-4add-401a-9225-d42f15700245 nodeName:}" failed. No retries permitted until 2026-08-04 18:14:55.283072208 +0000 UTC m=+837.725224476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls") pod "sequence-graph-315c2-6dffcdf597-99zwl" (UID: "4e6789d1-4add-401a-9225-d42f15700245") : secret "sequence-graph-315c2-serving-cert" not found
Aug 04 18:14:54.783472 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:54.783453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:55.288253 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.288219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:55.290585 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.290565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") pod \"sequence-graph-315c2-6dffcdf597-99zwl\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") " pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:55.502220 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.502174    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:55.633815 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.633660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:14:55.635996 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:14:55.635969    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6789d1_4add_401a_9225_d42f15700245.slice/crio-93d6dfba5311281e40e6552dffaf70460ae2d586bdd0ae7f2aa1f7f6bec7c942 WatchSource:0}: Error finding container 93d6dfba5311281e40e6552dffaf70460ae2d586bdd0ae7f2aa1f7f6bec7c942: Status 404 returned error can't find the container with id 93d6dfba5311281e40e6552dffaf70460ae2d586bdd0ae7f2aa1f7f6bec7c942
Aug 04 18:14:55.637821 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.637804    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:14:55.872391 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:55.872304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" event={"ID":"4e6789d1-4add-401a-9225-d42f15700245","Type":"ContainerStarted","Data":"93d6dfba5311281e40e6552dffaf70460ae2d586bdd0ae7f2aa1f7f6bec7c942"}
Aug 04 18:14:57.883373 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:57.883339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" event={"ID":"4e6789d1-4add-401a-9225-d42f15700245","Type":"ContainerStarted","Data":"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"}
Aug 04 18:14:57.883747 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:57.883472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:14:57.903935 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:14:57.903856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podStartSLOduration=2.109749781 podStartE2EDuration="3.903833525s" totalImagesPullingTime="1.794083744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:14:57.901573886 +0000 UTC m=+840.343726177" watchObservedRunningTime="2026-08-04 18:14:57.903833525 +0000 UTC m=+840.345985816"
Aug 04 18:15:03.892905 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:15:03.892862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:23:09.337489 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.337458    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:23:09.338032 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.337663    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" containerID="cri-o://395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378" gracePeriod=30
Aug 04 18:23:09.714626 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.714591    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:09.717973 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.717950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:09.720832 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.720808    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-a1525-kube-rbac-proxy-sar-config\""
Aug 04 18:23:09.720997 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.720808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-a1525-serving-cert\""
Aug 04 18:23:09.728470 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.728447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:09.895464 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.895430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:09.895637 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.895486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:09.996810 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.996727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:09.996810 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.996769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:09.997021 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:23:09.996859    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-a1525-serving-cert: secret "ensemble-graph-a1525-serving-cert" not found
Aug 04 18:23:09.997021 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:23:09.996944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls podName:f1d80978-d3aa-4da7-a702-3798d6859a47 nodeName:}" failed. No retries permitted until 2026-08-04 18:23:10.49692868 +0000 UTC m=+1332.939080949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls") pod "ensemble-graph-a1525-5c67bbd599-28jst" (UID: "f1d80978-d3aa-4da7-a702-3798d6859a47") : secret "ensemble-graph-a1525-serving-cert" not found
Aug 04 18:23:09.997332 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:09.997313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:10.501220 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.501177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:10.503582 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.503549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") pod \"ensemble-graph-a1525-5c67bbd599-28jst\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") " pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:10.628995 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.628957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:10.755957 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.755930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:10.757999 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:23:10.757971    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d80978_d3aa_4da7_a702_3798d6859a47.slice/crio-9708d7d9530aac3ec07ff96d8a26c853e5ca6ab82fed7abc97f639bf2c841a7b WatchSource:0}: Error finding container 9708d7d9530aac3ec07ff96d8a26c853e5ca6ab82fed7abc97f639bf2c841a7b: Status 404 returned error can't find the container with id 9708d7d9530aac3ec07ff96d8a26c853e5ca6ab82fed7abc97f639bf2c841a7b
Aug 04 18:23:10.888197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.888164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" event={"ID":"f1d80978-d3aa-4da7-a702-3798d6859a47","Type":"ContainerStarted","Data":"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"}
Aug 04 18:23:10.888484 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.888216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" event={"ID":"f1d80978-d3aa-4da7-a702-3798d6859a47","Type":"ContainerStarted","Data":"9708d7d9530aac3ec07ff96d8a26c853e5ca6ab82fed7abc97f639bf2c841a7b"}
Aug 04 18:23:10.888484 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.888244    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:10.907357 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:10.907310    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podStartSLOduration=1.907294862 podStartE2EDuration="1.907294862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:23:10.906205846 +0000 UTC m=+1333.348358140" watchObservedRunningTime="2026-08-04 18:23:10.907294862 +0000 UTC m=+1333.349447152"
Aug 04 18:23:13.891512 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:13.891471    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:16.897857 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:16.897822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:18.892164 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:18.892121    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:19.790999 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:19.790930    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:19.791126 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:19.791107    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" containerID="cri-o://917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc" gracePeriod=30
Aug 04 18:23:21.896313 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:21.896274    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:23.891250 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:23.891213    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:23.891599 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:23.891319    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:23:26.896579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:26.896540    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:28.891735 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:28.891696    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:31.899546 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:31.899499    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:31.899935 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:31.899783    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:33.891182 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:33.891140    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:36.895671 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:36.895632    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:38.891260 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:38.891219    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:39.481470 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.481445    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:23:39.536518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.536490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") pod \"4e6789d1-4add-401a-9225-d42f15700245\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") "
Aug 04 18:23:39.536659 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.536536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle\") pod \"4e6789d1-4add-401a-9225-d42f15700245\" (UID: \"4e6789d1-4add-401a-9225-d42f15700245\") "
Aug 04 18:23:39.536934 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.536880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4e6789d1-4add-401a-9225-d42f15700245" (UID: "4e6789d1-4add-401a-9225-d42f15700245"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:23:39.538469 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.538449    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4e6789d1-4add-401a-9225-d42f15700245" (UID: "4e6789d1-4add-401a-9225-d42f15700245"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:23:39.637297 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.637275    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e6789d1-4add-401a-9225-d42f15700245-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:23:39.637297 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:39.637296    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6789d1-4add-401a-9225-d42f15700245-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:23:40.006739 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.006642    2580 generic.go:356] "Generic (PLEG): container finished" podID="4e6789d1-4add-401a-9225-d42f15700245" containerID="395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378" exitCode=0
Aug 04 18:23:40.006739 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.006685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" event={"ID":"4e6789d1-4add-401a-9225-d42f15700245","Type":"ContainerDied","Data":"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"}
Aug 04 18:23:40.006739 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.006692    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"
Aug 04 18:23:40.007337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.006751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl" event={"ID":"4e6789d1-4add-401a-9225-d42f15700245","Type":"ContainerDied","Data":"93d6dfba5311281e40e6552dffaf70460ae2d586bdd0ae7f2aa1f7f6bec7c942"}
Aug 04 18:23:40.007337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.006773    2580 scope.go:117] "RemoveContainer" containerID="395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"
Aug 04 18:23:40.015348 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.015328    2580 scope.go:117] "RemoveContainer" containerID="395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"
Aug 04 18:23:40.015590 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:23:40.015570    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378\": container with ID starting with 395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378 not found: ID does not exist" containerID="395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"
Aug 04 18:23:40.015635 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.015598    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378"} err="failed to get container status \"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378\": rpc error: code = NotFound desc = could not find container \"395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378\": container with ID starting with 395b9afd1f9d7920c53e1ecfe6f0841847e692960ed86b4220504e746176e378 not found: ID does not exist"
Aug 04 18:23:40.029907 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.029871    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:23:40.034563 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.034544    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-315c2-6dffcdf597-99zwl"]
Aug 04 18:23:40.146539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:40.146506    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6789d1-4add-401a-9225-d42f15700245" path="/var/lib/kubelet/pods/4e6789d1-4add-401a-9225-d42f15700245/volumes"
Aug 04 18:23:41.895928 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:41.895880    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:46.895668 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:46.895626    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:23:49.977405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:49.977382    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:50.033670 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.033634    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") pod \"f1d80978-d3aa-4da7-a702-3798d6859a47\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") "
Aug 04 18:23:50.033828 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.033682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle\") pod \"f1d80978-d3aa-4da7-a702-3798d6859a47\" (UID: \"f1d80978-d3aa-4da7-a702-3798d6859a47\") "
Aug 04 18:23:50.034065 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.034043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f1d80978-d3aa-4da7-a702-3798d6859a47" (UID: "f1d80978-d3aa-4da7-a702-3798d6859a47"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:23:50.035586 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.035568    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f1d80978-d3aa-4da7-a702-3798d6859a47" (UID: "f1d80978-d3aa-4da7-a702-3798d6859a47"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:23:50.049340 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.049272    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerID="917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc" exitCode=0
Aug 04 18:23:50.049340 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.049318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"
Aug 04 18:23:50.049461 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.049346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" event={"ID":"f1d80978-d3aa-4da7-a702-3798d6859a47","Type":"ContainerDied","Data":"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"}
Aug 04 18:23:50.049461 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.049387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst" event={"ID":"f1d80978-d3aa-4da7-a702-3798d6859a47","Type":"ContainerDied","Data":"9708d7d9530aac3ec07ff96d8a26c853e5ca6ab82fed7abc97f639bf2c841a7b"}
Aug 04 18:23:50.049461 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.049407    2580 scope.go:117] "RemoveContainer" containerID="917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"
Aug 04 18:23:50.057697 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.057677    2580 scope.go:117] "RemoveContainer" containerID="917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"
Aug 04 18:23:50.057986 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:23:50.057960    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc\": container with ID starting with 917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc not found: ID does not exist" containerID="917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"
Aug 04 18:23:50.058068 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.057986    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc"} err="failed to get container status \"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc\": rpc error: code = NotFound desc = could not find container \"917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc\": container with ID starting with 917033c45cbe6c5bdd743547894e755077f1d91fb8a12a8cc4aa3f3a1e4282fc not found: ID does not exist"
Aug 04 18:23:50.072950 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.072926    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:50.077621 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.077601    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a1525-5c67bbd599-28jst"]
Aug 04 18:23:50.134282 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.134253    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1d80978-d3aa-4da7-a702-3798d6859a47-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:23:50.134282 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.134280    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1d80978-d3aa-4da7-a702-3798d6859a47-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:23:50.150789 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:23:50.150756    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" path="/var/lib/kubelet/pods/f1d80978-d3aa-4da7-a702-3798d6859a47/volumes"
Aug 04 18:24:09.558204 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558174    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:09.558608 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558521    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525"
Aug 04 18:24:09.558608 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558532    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525"
Aug 04 18:24:09.558608 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558549    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2"
Aug 04 18:24:09.558608 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558555    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2"
Aug 04 18:24:09.558741 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558610    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6789d1-4add-401a-9225-d42f15700245" containerName="sequence-graph-315c2"
Aug 04 18:24:09.558741 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.558619    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d80978-d3aa-4da7-a702-3798d6859a47" containerName="ensemble-graph-a1525"
Aug 04 18:24:09.562933 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.562913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:09.565765 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.565745    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-94d00-kube-rbac-proxy-sar-config\""
Aug 04 18:24:09.565884 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.565837    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-94d00-serving-cert\""
Aug 04 18:24:09.565884 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.565842    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64gfv\""
Aug 04 18:24:09.567053 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.567036    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 04 18:24:09.570937 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.570913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:09.706272 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.706242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:09.706414 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.706311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:09.807058 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.807032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:09.807157 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.807094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:09.807213 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:24:09.807200    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-94d00-serving-cert: secret "sequence-graph-94d00-serving-cert" not found
Aug 04 18:24:09.807276 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:24:09.807267    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls podName:591fcfd7-19ff-4a5e-a480-1c1312a2e628 nodeName:}" failed. No retries permitted until 2026-08-04 18:24:10.307248873 +0000 UTC m=+1392.749401144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls") pod "sequence-graph-94d00-868df69ffb-5rp86" (UID: "591fcfd7-19ff-4a5e-a480-1c1312a2e628") : secret "sequence-graph-94d00-serving-cert" not found
Aug 04 18:24:09.807676 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:09.807656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:10.311562 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:10.311519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:10.314025 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:10.314001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") pod \"sequence-graph-94d00-868df69ffb-5rp86\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") " pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:10.474545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:10.474507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:10.600820 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:10.600801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:10.602995 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:24:10.602969    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591fcfd7_19ff_4a5e_a480_1c1312a2e628.slice/crio-dfe8caa5b040dc90c9292582a29edbc9962a5e7f0b336855b3903f26c9d0baab WatchSource:0}: Error finding container dfe8caa5b040dc90c9292582a29edbc9962a5e7f0b336855b3903f26c9d0baab: Status 404 returned error can't find the container with id dfe8caa5b040dc90c9292582a29edbc9962a5e7f0b336855b3903f26c9d0baab
Aug 04 18:24:11.137542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:11.137501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" event={"ID":"591fcfd7-19ff-4a5e-a480-1c1312a2e628","Type":"ContainerStarted","Data":"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"}
Aug 04 18:24:11.137718 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:11.137565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" event={"ID":"591fcfd7-19ff-4a5e-a480-1c1312a2e628","Type":"ContainerStarted","Data":"dfe8caa5b040dc90c9292582a29edbc9962a5e7f0b336855b3903f26c9d0baab"}
Aug 04 18:24:11.137718 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:11.137609    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:11.156907 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:11.156832    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podStartSLOduration=2.156812295 podStartE2EDuration="2.156812295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:11.155962733 +0000 UTC m=+1393.598115024" watchObservedRunningTime="2026-08-04 18:24:11.156812295 +0000 UTC m=+1393.598964590"
Aug 04 18:24:17.146699 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:17.146667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:19.767689 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:19.767609    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:19.768095 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:19.767777    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" containerID="cri-o://0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3" gracePeriod=30
Aug 04 18:24:20.226083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.226051    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:24:20.229215 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.229195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.236608 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.236592    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-a162f-kube-rbac-proxy-sar-config\""
Aug 04 18:24:20.239560 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.239542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-a162f-serving-cert\""
Aug 04 18:24:20.293905 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.293863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.294069 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.294007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.308294 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.308264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:24:20.394721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.394687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.394912 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.394770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.394912 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:24:20.394862    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-a162f-serving-cert: secret "ensemble-graph-a162f-serving-cert" not found
Aug 04 18:24:20.394996 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:24:20.394958    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls podName:88250085-df14-4547-9a2e-9b3e6892f3d1 nodeName:}" failed. No retries permitted until 2026-08-04 18:24:20.894937078 +0000 UTC m=+1403.337089358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls") pod "ensemble-graph-a162f-964d79f84-rgrt2" (UID: "88250085-df14-4547-9a2e-9b3e6892f3d1") : secret "ensemble-graph-a162f-serving-cert" not found
Aug 04 18:24:20.395332 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.395312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.898552 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.898512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:20.901004 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:20.900982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") pod \"ensemble-graph-a162f-964d79f84-rgrt2\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") " pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:21.139298 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:21.139258    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:21.299480 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:21.299454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:24:21.302153 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:24:21.302125    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88250085_df14_4547_9a2e_9b3e6892f3d1.slice/crio-6589f00dbfe404f0884aa7f147950db9b601e17206c5d22725c6499dc4dfe834 WatchSource:0}: Error finding container 6589f00dbfe404f0884aa7f147950db9b601e17206c5d22725c6499dc4dfe834: Status 404 returned error can't find the container with id 6589f00dbfe404f0884aa7f147950db9b601e17206c5d22725c6499dc4dfe834
Aug 04 18:24:22.146194 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:22.146162    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:22.185724 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:22.185684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" event={"ID":"88250085-df14-4547-9a2e-9b3e6892f3d1","Type":"ContainerStarted","Data":"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"}
Aug 04 18:24:22.185931 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:22.185741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" event={"ID":"88250085-df14-4547-9a2e-9b3e6892f3d1","Type":"ContainerStarted","Data":"6589f00dbfe404f0884aa7f147950db9b601e17206c5d22725c6499dc4dfe834"}
Aug 04 18:24:22.185931 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:22.185814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:27.145150 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:27.145110    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:28.195734 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:28.195705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:24:28.229057 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:28.229004    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podStartSLOduration=8.228987407 podStartE2EDuration="8.228987407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:24:22.211436742 +0000 UTC m=+1404.653589033" watchObservedRunningTime="2026-08-04 18:24:28.228987407 +0000 UTC m=+1410.671139699"
Aug 04 18:24:32.147013 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:32.146977    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:32.147545 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:32.147074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:37.145133 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:37.145096    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:42.146169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:42.146122    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:47.145306 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:47.145267    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:24:49.909712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:49.909689    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:50.057729 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.057644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") pod \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") "
Aug 04 18:24:50.057729 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.057682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle\") pod \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\" (UID: \"591fcfd7-19ff-4a5e-a480-1c1312a2e628\") "
Aug 04 18:24:50.058097 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.058076    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "591fcfd7-19ff-4a5e-a480-1c1312a2e628" (UID: "591fcfd7-19ff-4a5e-a480-1c1312a2e628"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:24:50.059784 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.059762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "591fcfd7-19ff-4a5e-a480-1c1312a2e628" (UID: "591fcfd7-19ff-4a5e-a480-1c1312a2e628"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:24:50.158696 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.158671    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/591fcfd7-19ff-4a5e-a480-1c1312a2e628-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:24:50.158696 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.158696    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591fcfd7-19ff-4a5e-a480-1c1312a2e628-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:24:50.299837 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.299797    2580 generic.go:356] "Generic (PLEG): container finished" podID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerID="0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3" exitCode=0
Aug 04 18:24:50.300034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.299844    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"
Aug 04 18:24:50.300034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.299882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" event={"ID":"591fcfd7-19ff-4a5e-a480-1c1312a2e628","Type":"ContainerDied","Data":"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"}
Aug 04 18:24:50.300034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.299961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86" event={"ID":"591fcfd7-19ff-4a5e-a480-1c1312a2e628","Type":"ContainerDied","Data":"dfe8caa5b040dc90c9292582a29edbc9962a5e7f0b336855b3903f26c9d0baab"}
Aug 04 18:24:50.300034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.299989    2580 scope.go:117] "RemoveContainer" containerID="0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"
Aug 04 18:24:50.307989 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.307969    2580 scope.go:117] "RemoveContainer" containerID="0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"
Aug 04 18:24:50.308228 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:24:50.308200    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3\": container with ID starting with 0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3 not found: ID does not exist" containerID="0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"
Aug 04 18:24:50.308333 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.308233    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3"} err="failed to get container status \"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3\": rpc error: code = NotFound desc = could not find container \"0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3\": container with ID starting with 0bbe289ef842a685f8c16f4ac6b71b9584c4f3c224d2f89edccc02a7d3a82ac3 not found: ID does not exist"
Aug 04 18:24:50.320295 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.320267    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:50.325017 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:50.324996    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-94d00-868df69ffb-5rp86"]
Aug 04 18:24:52.145766 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:24:52.145733    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" path="/var/lib/kubelet/pods/591fcfd7-19ff-4a5e-a480-1c1312a2e628/volumes"
Aug 04 18:25:20.091039 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.091003    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:25:20.091449 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.091365    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00"
Aug 04 18:25:20.091449 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.091377    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00"
Aug 04 18:25:20.091522 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.091452    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="591fcfd7-19ff-4a5e-a480-1c1312a2e628" containerName="sequence-graph-94d00"
Aug 04 18:25:20.095549 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.095533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.098471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.098449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d5455-serving-cert\""
Aug 04 18:25:20.098952 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.098935    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d5455-kube-rbac-proxy-sar-config\""
Aug 04 18:25:20.105692 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.105663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:25:20.219377 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.219342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.219377 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.219383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.320305 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.320265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.320305 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.320308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.320513 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:25:20.320456    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-d5455-serving-cert: secret "sequence-graph-d5455-serving-cert" not found
Aug 04 18:25:20.320550 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:25:20.320536    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls podName:fea9c67b-57df-410b-909a-728d1237c854 nodeName:}" failed. No retries permitted until 2026-08-04 18:25:20.820518118 +0000 UTC m=+1463.262670390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls") pod "sequence-graph-d5455-58879b467-qdxfr" (UID: "fea9c67b-57df-410b-909a-728d1237c854") : secret "sequence-graph-d5455-serving-cert" not found
Aug 04 18:25:20.320955 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.320935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.825285 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.825246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:20.827594 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:20.827565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") pod \"sequence-graph-d5455-58879b467-qdxfr\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") " pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:21.006621 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.006583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:21.136150 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.136119    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:25:21.139110 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:25:21.139084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea9c67b_57df_410b_909a_728d1237c854.slice/crio-27d1db72e173db3406293742e09d846821274b6d5ea3d29f7f56ea63532c67f5 WatchSource:0}: Error finding container 27d1db72e173db3406293742e09d846821274b6d5ea3d29f7f56ea63532c67f5: Status 404 returned error can't find the container with id 27d1db72e173db3406293742e09d846821274b6d5ea3d29f7f56ea63532c67f5
Aug 04 18:25:21.427284 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.427239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" event={"ID":"fea9c67b-57df-410b-909a-728d1237c854","Type":"ContainerStarted","Data":"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"}
Aug 04 18:25:21.427490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.427295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" event={"ID":"fea9c67b-57df-410b-909a-728d1237c854","Type":"ContainerStarted","Data":"27d1db72e173db3406293742e09d846821274b6d5ea3d29f7f56ea63532c67f5"}
Aug 04 18:25:21.427490 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.427376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:25:21.447650 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:21.447603    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podStartSLOduration=1.447588602 podStartE2EDuration="1.447588602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:25:21.447218901 +0000 UTC m=+1463.889371194" watchObservedRunningTime="2026-08-04 18:25:21.447588602 +0000 UTC m=+1463.889740892"
Aug 04 18:25:27.438583 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:25:27.438554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:32:34.874579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:34.874545    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:32:34.875100 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:34.874730    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" containerID="cri-o://02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3" gracePeriod=30
Aug 04 18:32:38.193667 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:38.193627    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:32:43.194678 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:43.194632    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:32:48.193977 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:48.193942    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:32:48.194351 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:48.194039    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:32:53.194050 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:53.194007    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:32:58.194845 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:32:58.194806    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:03.194181 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:03.194143    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:05.017278 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.017252    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:33:05.105706 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.105674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") pod \"88250085-df14-4547-9a2e-9b3e6892f3d1\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") "
Aug 04 18:33:05.105877 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.105747    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle\") pod \"88250085-df14-4547-9a2e-9b3e6892f3d1\" (UID: \"88250085-df14-4547-9a2e-9b3e6892f3d1\") "
Aug 04 18:33:05.106107 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.106082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "88250085-df14-4547-9a2e-9b3e6892f3d1" (UID: "88250085-df14-4547-9a2e-9b3e6892f3d1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:33:05.107721 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.107702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "88250085-df14-4547-9a2e-9b3e6892f3d1" (UID: "88250085-df14-4547-9a2e-9b3e6892f3d1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:33:05.207164 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.207096    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/88250085-df14-4547-9a2e-9b3e6892f3d1-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:33:05.207164 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.207120    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88250085-df14-4547-9a2e-9b3e6892f3d1-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:33:05.333961 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.333928    2580 generic.go:356] "Generic (PLEG): container finished" podID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerID="02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3" exitCode=0
Aug 04 18:33:05.334131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.333979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"
Aug 04 18:33:05.334131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.333992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" event={"ID":"88250085-df14-4547-9a2e-9b3e6892f3d1","Type":"ContainerDied","Data":"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"}
Aug 04 18:33:05.334131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.334039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2" event={"ID":"88250085-df14-4547-9a2e-9b3e6892f3d1","Type":"ContainerDied","Data":"6589f00dbfe404f0884aa7f147950db9b601e17206c5d22725c6499dc4dfe834"}
Aug 04 18:33:05.334131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.334063    2580 scope.go:117] "RemoveContainer" containerID="02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"
Aug 04 18:33:05.342405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.342384    2580 scope.go:117] "RemoveContainer" containerID="02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"
Aug 04 18:33:05.342661 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:33:05.342643    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3\": container with ID starting with 02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3 not found: ID does not exist" containerID="02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"
Aug 04 18:33:05.342718 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.342668    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3"} err="failed to get container status \"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3\": rpc error: code = NotFound desc = could not find container \"02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3\": container with ID starting with 02f3307a7c911004a3656b977b72103a8b074f65ec432f91f2f7d2eb9a9f98d3 not found: ID does not exist"
Aug 04 18:33:05.360232 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.359991    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:33:05.361593 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:05.361573    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-a162f-964d79f84-rgrt2"]
Aug 04 18:33:06.145927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:06.145878    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" path="/var/lib/kubelet/pods/88250085-df14-4547-9a2e-9b3e6892f3d1/volumes"
Aug 04 18:33:34.833066 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:34.833034    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:33:34.833538 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:34.833315    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" containerID="cri-o://6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f" gracePeriod=30
Aug 04 18:33:35.138326 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.138295    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:33:35.138666 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.138653    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f"
Aug 04 18:33:35.138712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.138668    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f"
Aug 04 18:33:35.138748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.138737    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="88250085-df14-4547-9a2e-9b3e6892f3d1" containerName="ensemble-graph-a162f"
Aug 04 18:33:35.141662 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.141642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.144719 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.144681    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-8c81a-kube-rbac-proxy-sar-config\""
Aug 04 18:33:35.144807 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.144688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-8c81a-serving-cert\""
Aug 04 18:33:35.156014 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.155983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:33:35.257832 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.257807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.257999 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.257846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.358663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.358634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.358824 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.358722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.359354 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.359337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.360985 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.360963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls\") pod \"splitter-graph-8c81a-784498d6cc-9qrmg\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") " pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.452227 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.452156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:35.581726 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:35.581700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:33:35.583955 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:33:35.583924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469b2a7b_27c4_4be7_92ff_d1b28ea49730.slice/crio-852c2d810b900f0e38f265664641212d40985fb58900f0704f7761a1bef4fb2d WatchSource:0}: Error finding container 852c2d810b900f0e38f265664641212d40985fb58900f0704f7761a1bef4fb2d: Status 404 returned error can't find the container with id 852c2d810b900f0e38f265664641212d40985fb58900f0704f7761a1bef4fb2d
Aug 04 18:33:36.461227 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:36.461194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" event={"ID":"469b2a7b-27c4-4be7-92ff-d1b28ea49730","Type":"ContainerStarted","Data":"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"}
Aug 04 18:33:36.461622 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:36.461244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" event={"ID":"469b2a7b-27c4-4be7-92ff-d1b28ea49730","Type":"ContainerStarted","Data":"852c2d810b900f0e38f265664641212d40985fb58900f0704f7761a1bef4fb2d"}
Aug 04 18:33:36.461622 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:36.461331    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:36.483723 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:36.483679    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podStartSLOduration=1.483665415 podStartE2EDuration="1.483665415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:33:36.482678017 +0000 UTC m=+1958.924830309" watchObservedRunningTime="2026-08-04 18:33:36.483665415 +0000 UTC m=+1958.925817705"
Aug 04 18:33:37.436558 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:37.436518    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:42.436243 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:42.436204    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:42.471203 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:42.471174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:33:45.217482 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:45.217454    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:33:45.217919 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:45.217614    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" containerID="cri-o://0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3" gracePeriod=30
Aug 04 18:33:47.436041 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:47.436000    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:47.436436 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:47.436105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:33:47.469304 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:47.469271    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:52.436879 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:52.436838    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:52.469958 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:52.469926    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:57.436663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:57.436622    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:57.469331 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:57.469292    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:33:57.469506 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:33:57.469403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:34:02.436369 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:02.436333    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:34:02.469330 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:02.469294    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:34:04.970085 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:04.970061    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:34:05.106539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.106456    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle\") pod \"fea9c67b-57df-410b-909a-728d1237c854\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") "
Aug 04 18:34:05.106539 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.106497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") pod \"fea9c67b-57df-410b-909a-728d1237c854\" (UID: \"fea9c67b-57df-410b-909a-728d1237c854\") "
Aug 04 18:34:05.106831 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.106811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fea9c67b-57df-410b-909a-728d1237c854" (UID: "fea9c67b-57df-410b-909a-728d1237c854"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:34:05.108526 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.108504    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fea9c67b-57df-410b-909a-728d1237c854" (UID: "fea9c67b-57df-410b-909a-728d1237c854"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:34:05.207276 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.207244    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fea9c67b-57df-410b-909a-728d1237c854-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:34:05.207276 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.207271    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fea9c67b-57df-410b-909a-728d1237c854-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:34:05.583316 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.583282    2580 generic.go:356] "Generic (PLEG): container finished" podID="fea9c67b-57df-410b-909a-728d1237c854" containerID="6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f" exitCode=0
Aug 04 18:34:05.583497 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.583326    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"
Aug 04 18:34:05.583497 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.583366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" event={"ID":"fea9c67b-57df-410b-909a-728d1237c854","Type":"ContainerDied","Data":"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"}
Aug 04 18:34:05.583497 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.583413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr" event={"ID":"fea9c67b-57df-410b-909a-728d1237c854","Type":"ContainerDied","Data":"27d1db72e173db3406293742e09d846821274b6d5ea3d29f7f56ea63532c67f5"}
Aug 04 18:34:05.583497 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.583436    2580 scope.go:117] "RemoveContainer" containerID="6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"
Aug 04 18:34:05.591464 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.591449    2580 scope.go:117] "RemoveContainer" containerID="6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"
Aug 04 18:34:05.591710 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:34:05.591690    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f\": container with ID starting with 6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f not found: ID does not exist" containerID="6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"
Aug 04 18:34:05.591758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.591718    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f"} err="failed to get container status \"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f\": rpc error: code = NotFound desc = could not find container \"6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f\": container with ID starting with 6ce3504313c36c6b5ce8706a0e1942aa275ec116fb2b536778957ec14d590b2f not found: ID does not exist"
Aug 04 18:34:05.607958 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.607936    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:34:05.614609 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:05.614588    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d5455-58879b467-qdxfr"]
Aug 04 18:34:06.145690 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:06.145655    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea9c67b-57df-410b-909a-728d1237c854" path="/var/lib/kubelet/pods/fea9c67b-57df-410b-909a-728d1237c854/volumes"
Aug 04 18:34:07.469646 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:07.469612    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:34:12.469252 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:12.469214    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:34:15.364158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.364133    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:34:15.494158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.494082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls\") pod \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") "
Aug 04 18:34:15.494158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.494143    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle\") pod \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\" (UID: \"469b2a7b-27c4-4be7-92ff-d1b28ea49730\") "
Aug 04 18:34:15.494493 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.494469    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "469b2a7b-27c4-4be7-92ff-d1b28ea49730" (UID: "469b2a7b-27c4-4be7-92ff-d1b28ea49730"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:34:15.496034 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.496013    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "469b2a7b-27c4-4be7-92ff-d1b28ea49730" (UID: "469b2a7b-27c4-4be7-92ff-d1b28ea49730"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:34:15.595114 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.595079    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/469b2a7b-27c4-4be7-92ff-d1b28ea49730-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:34:15.595114 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.595108    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/469b2a7b-27c4-4be7-92ff-d1b28ea49730-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:34:15.624725 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.624687    2580 generic.go:356] "Generic (PLEG): container finished" podID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerID="0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3" exitCode=0
Aug 04 18:34:15.624910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.624742    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"
Aug 04 18:34:15.624910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.624753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" event={"ID":"469b2a7b-27c4-4be7-92ff-d1b28ea49730","Type":"ContainerDied","Data":"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"}
Aug 04 18:34:15.624910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.624825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg" event={"ID":"469b2a7b-27c4-4be7-92ff-d1b28ea49730","Type":"ContainerDied","Data":"852c2d810b900f0e38f265664641212d40985fb58900f0704f7761a1bef4fb2d"}
Aug 04 18:34:15.624910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.624859    2580 scope.go:117] "RemoveContainer" containerID="0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"
Aug 04 18:34:15.633826 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.633811    2580 scope.go:117] "RemoveContainer" containerID="0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"
Aug 04 18:34:15.634120 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:34:15.634100    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3\": container with ID starting with 0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3 not found: ID does not exist" containerID="0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"
Aug 04 18:34:15.634217 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.634125    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3"} err="failed to get container status \"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3\": rpc error: code = NotFound desc = could not find container \"0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3\": container with ID starting with 0cdfdef18b6780e15d61b2a1e5f40dfb48f9f93f35ac2a75e5b0680396bc79c3 not found: ID does not exist"
Aug 04 18:34:15.653165 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.653142    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:34:15.655454 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:15.655434    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8c81a-784498d6cc-9qrmg"]
Aug 04 18:34:16.145958 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:16.145927    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" path="/var/lib/kubelet/pods/469b2a7b-27c4-4be7-92ff-d1b28ea49730/volumes"
Aug 04 18:34:35.121364 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121330    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121662    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455"
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121672    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455"
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121687    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a"
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121693    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a"
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121746    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea9c67b-57df-410b-909a-728d1237c854" containerName="sequence-graph-d5455"
Aug 04 18:34:35.121795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.121754    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="469b2a7b-27c4-4be7-92ff-d1b28ea49730" containerName="splitter-graph-8c81a"
Aug 04 18:34:35.124517 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.124500    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.127178 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.127151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-493ba-serving-cert\""
Aug 04 18:34:35.127310 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.127178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 04 18:34:35.127310 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.127197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64gfv\""
Aug 04 18:34:35.127310 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.127221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-493ba-kube-rbac-proxy-sar-config\""
Aug 04 18:34:35.134751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.134731    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:34:35.242590 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.242560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.242792 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.242614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.343795 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.343762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.343981 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.343808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.344419 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.344398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.346158 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.346136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls\") pod \"switch-graph-493ba-59c7bfbd4c-f2ddc\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") " pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.434757 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.434732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.563572 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.563546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:34:35.565067 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:34:35.565044    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08522f59_643c_4777_b923_3c3a292c0b4f.slice/crio-735d3a6539a25adf986f3114a82bd2794d09b169270d6c04473c430fc32cce86 WatchSource:0}: Error finding container 735d3a6539a25adf986f3114a82bd2794d09b169270d6c04473c430fc32cce86: Status 404 returned error can't find the container with id 735d3a6539a25adf986f3114a82bd2794d09b169270d6c04473c430fc32cce86
Aug 04 18:34:35.710867 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.710783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" event={"ID":"08522f59-643c-4777-b923-3c3a292c0b4f","Type":"ContainerStarted","Data":"0dbd64a64b2c787c357cdddb1a3f26cab5a642020cd2fb3db891c8856c2dd9e9"}
Aug 04 18:34:35.710867 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.710840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" event={"ID":"08522f59-643c-4777-b923-3c3a292c0b4f","Type":"ContainerStarted","Data":"735d3a6539a25adf986f3114a82bd2794d09b169270d6c04473c430fc32cce86"}
Aug 04 18:34:35.711122 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.710898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:35.733663 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:35.733615    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podStartSLOduration=0.733600681 podStartE2EDuration="733.600681ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:35.732948804 +0000 UTC m=+2018.175101096" watchObservedRunningTime="2026-08-04 18:34:35.733600681 +0000 UTC m=+2018.175752972"
Aug 04 18:34:41.720174 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:41.720141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:34:45.530647 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.530618    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:34:45.534090 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.534072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.540477 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.540460    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-47ede-serving-cert\""
Aug 04 18:34:45.543440 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.543421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-47ede-kube-rbac-proxy-sar-config\""
Aug 04 18:34:45.556150 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.556129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:34:45.634847 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.634819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.635021 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.634855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.735834 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.735804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.735994 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.735910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.736452 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.736430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.738206 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.738188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls\") pod \"splitter-graph-47ede-d4cf4b666-4btmn\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") " pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.843637 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.843542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:45.973682 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:45.973658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:34:45.975416 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:34:45.975388    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a8c37b_72fb_4f77_a36d_36aebb940e9d.slice/crio-41f13c24f6d4e7d2ccc29d77ada13bfa039322e2a940eb62d4c9cf3d7c253b0c WatchSource:0}: Error finding container 41f13c24f6d4e7d2ccc29d77ada13bfa039322e2a940eb62d4c9cf3d7c253b0c: Status 404 returned error can't find the container with id 41f13c24f6d4e7d2ccc29d77ada13bfa039322e2a940eb62d4c9cf3d7c253b0c
Aug 04 18:34:46.757623 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:46.757584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" event={"ID":"48a8c37b-72fb-4f77-a36d-36aebb940e9d","Type":"ContainerStarted","Data":"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"}
Aug 04 18:34:46.758031 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:46.757636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" event={"ID":"48a8c37b-72fb-4f77-a36d-36aebb940e9d","Type":"ContainerStarted","Data":"41f13c24f6d4e7d2ccc29d77ada13bfa039322e2a940eb62d4c9cf3d7c253b0c"}
Aug 04 18:34:46.758031 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:46.757713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:34:46.787714 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:46.787672    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podStartSLOduration=1.787659182 podStartE2EDuration="1.787659182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:34:46.787173339 +0000 UTC m=+2029.229325643" watchObservedRunningTime="2026-08-04 18:34:46.787659182 +0000 UTC m=+2029.229811482"
Aug 04 18:34:52.767589 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:34:52.767559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:43:00.176904 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:00.176819    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:43:00.179449 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:00.177028    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" containerID="cri-o://7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d" gracePeriod=30
Aug 04 18:43:02.765592 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:02.765547    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:07.765426 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:07.765388    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:12.765618 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:12.765573    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:12.766124 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:12.765692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:43:17.765803 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:17.765752    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:22.765471 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:22.765422    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:27.765625 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:27.765584    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:43:30.331802 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.331775    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:43:30.483287 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.483201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle\") pod \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") "
Aug 04 18:43:30.483451 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.483298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls\") pod \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\" (UID: \"48a8c37b-72fb-4f77-a36d-36aebb940e9d\") "
Aug 04 18:43:30.483609 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.483584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "48a8c37b-72fb-4f77-a36d-36aebb940e9d" (UID: "48a8c37b-72fb-4f77-a36d-36aebb940e9d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:43:30.485151 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.485129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "48a8c37b-72fb-4f77-a36d-36aebb940e9d" (UID: "48a8c37b-72fb-4f77-a36d-36aebb940e9d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:43:30.584169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.584131    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a8c37b-72fb-4f77-a36d-36aebb940e9d-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:43:30.584169 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.584168    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48a8c37b-72fb-4f77-a36d-36aebb940e9d-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:43:30.884923 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.884874    2580 generic.go:356] "Generic (PLEG): container finished" podID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerID="7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d" exitCode=137
Aug 04 18:43:30.885081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.884927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" event={"ID":"48a8c37b-72fb-4f77-a36d-36aebb940e9d","Type":"ContainerDied","Data":"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"}
Aug 04 18:43:30.885081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.884950    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"
Aug 04 18:43:30.885081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.884987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn" event={"ID":"48a8c37b-72fb-4f77-a36d-36aebb940e9d","Type":"ContainerDied","Data":"41f13c24f6d4e7d2ccc29d77ada13bfa039322e2a940eb62d4c9cf3d7c253b0c"}
Aug 04 18:43:30.885081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.885018    2580 scope.go:117] "RemoveContainer" containerID="7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"
Aug 04 18:43:30.893864 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.893848    2580 scope.go:117] "RemoveContainer" containerID="7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"
Aug 04 18:43:30.894160 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:43:30.894142    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d\": container with ID starting with 7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d not found: ID does not exist" containerID="7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"
Aug 04 18:43:30.894226 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.894170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d"} err="failed to get container status \"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d\": rpc error: code = NotFound desc = could not find container \"7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d\": container with ID starting with 7fdb013de8513d6c8bf3d09eba693c4b84c35d72f2bbccc7d4e146b843e3470d not found: ID does not exist"
Aug 04 18:43:30.908500 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.908473    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:43:30.913412 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:30.913387    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-47ede-d4cf4b666-4btmn"]
Aug 04 18:43:32.146464 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:43:32.146430    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" path="/var/lib/kubelet/pods/48a8c37b-72fb-4f77-a36d-36aebb940e9d/volumes"
Aug 04 18:50:54.357936 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:54.357906    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:50:54.360394 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:54.358113    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" containerID="cri-o://0dbd64a64b2c787c357cdddb1a3f26cab5a642020cd2fb3db891c8856c2dd9e9" gracePeriod=30
Aug 04 18:50:56.108645 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.108612    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b54w5/must-gather-r4vgz"]
Aug 04 18:50:56.109044 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.108991    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede"
Aug 04 18:50:56.109044 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.109005    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede"
Aug 04 18:50:56.109131 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.109063    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a8c37b-72fb-4f77-a36d-36aebb940e9d" containerName="splitter-graph-47ede"
Aug 04 18:50:56.111598 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.111582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.114148 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.114119    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b54w5\"/\"openshift-service-ca.crt\""
Aug 04 18:50:56.114148 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.114142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b54w5\"/\"kube-root-ca.crt\""
Aug 04 18:50:56.114329 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.114176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b54w5\"/\"default-dockercfg-bpzmz\""
Aug 04 18:50:56.120596 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.120568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b54w5/must-gather-r4vgz"]
Aug 04 18:50:56.208083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.208047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ptm6\" (UniqueName: \"kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.208083 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.208086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.309355 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.309324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ptm6\" (UniqueName: \"kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.309355 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.309358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.309623 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.309610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.319115 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.319086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ptm6\" (UniqueName: \"kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6\") pod \"must-gather-r4vgz\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") " pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.434751 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.434726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:50:56.560920 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.560877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b54w5/must-gather-r4vgz"]
Aug 04 18:50:56.563091 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:50:56.563063    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd85bfdad_ddd0_4f9f_b301_93c6a6523557.slice/crio-c0535558b512f018fd0adc966c3db807ed9bdd18b7dda4bbe3e0c3bb02aac67d WatchSource:0}: Error finding container c0535558b512f018fd0adc966c3db807ed9bdd18b7dda4bbe3e0c3bb02aac67d: Status 404 returned error can't find the container with id c0535558b512f018fd0adc966c3db807ed9bdd18b7dda4bbe3e0c3bb02aac67d
Aug 04 18:50:56.564986 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.564967    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:50:56.679576 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.679543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b54w5/must-gather-r4vgz" event={"ID":"d85bfdad-ddd0-4f9f-b301-93c6a6523557","Type":"ContainerStarted","Data":"c0535558b512f018fd0adc966c3db807ed9bdd18b7dda4bbe3e0c3bb02aac67d"}
Aug 04 18:50:56.719358 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:50:56.719298    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:01.719337 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:01.719292    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:03.714154 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:03.714120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b54w5/must-gather-r4vgz" event={"ID":"d85bfdad-ddd0-4f9f-b301-93c6a6523557","Type":"ContainerStarted","Data":"ef799f8daa7157bdaae08df6a86b81d523df5dd84e0ca8ed0878ba88f65ff812"}
Aug 04 18:51:04.721058 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:04.721009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b54w5/must-gather-r4vgz" event={"ID":"d85bfdad-ddd0-4f9f-b301-93c6a6523557","Type":"ContainerStarted","Data":"8c72ca9a8088741bc7cf5184cc00bc5b03c30cfdf760ae0192388b6fca20d722"}
Aug 04 18:51:04.739354 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:04.739266    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b54w5/must-gather-r4vgz" podStartSLOduration=1.822612248 podStartE2EDuration="8.73924469s" totalImagesPullingTime="6.916632442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:51:04.738117624 +0000 UTC m=+3007.180269914" watchObservedRunningTime="2026-08-04 18:51:04.73924469 +0000 UTC m=+3007.181396983"
Aug 04 18:51:06.719755 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:06.719627    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:06.720274 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:06.719770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:51:11.719820 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:11.719780    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:12.440371 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:12.440340    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:13.314737 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:13.314706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:14.196680 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:14.196640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:15.042841 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:15.042808    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:15.868052 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:15.868022    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:16.692200 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:16.692146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:16.721296 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:16.721264    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:17.665839 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:17.665799    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:18.500225 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:18.500195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:19.337132 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:19.337097    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:20.157262 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:20.157221    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:20.985402 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:20.985374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:21.719018 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:21.718982    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 18:51:21.834149 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:21.834120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:22.680676 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:22.680646    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:23.557638 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:23.557609    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-493ba-59c7bfbd4c-f2ddc_08522f59-643c-4777-b923-3c3a292c0b4f/switch-graph-493ba/0.log"
Aug 04 18:51:24.813365 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:24.813336    2580 generic.go:356] "Generic (PLEG): container finished" podID="08522f59-643c-4777-b923-3c3a292c0b4f" containerID="0dbd64a64b2c787c357cdddb1a3f26cab5a642020cd2fb3db891c8856c2dd9e9" exitCode=0
Aug 04 18:51:24.813839 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:24.813400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" event={"ID":"08522f59-643c-4777-b923-3c3a292c0b4f","Type":"ContainerDied","Data":"0dbd64a64b2c787c357cdddb1a3f26cab5a642020cd2fb3db891c8856c2dd9e9"}
Aug 04 18:51:25.140245 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.140209    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:51:25.280781 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.280740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle\") pod \"08522f59-643c-4777-b923-3c3a292c0b4f\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") "
Aug 04 18:51:25.281002 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.280843    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls\") pod \"08522f59-643c-4777-b923-3c3a292c0b4f\" (UID: \"08522f59-643c-4777-b923-3c3a292c0b4f\") "
Aug 04 18:51:25.281234 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.281204    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "08522f59-643c-4777-b923-3c3a292c0b4f" (UID: "08522f59-643c-4777-b923-3c3a292c0b4f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:51:25.282940 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.282920    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "08522f59-643c-4777-b923-3c3a292c0b4f" (UID: "08522f59-643c-4777-b923-3c3a292c0b4f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:51:25.381519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.381485    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08522f59-643c-4777-b923-3c3a292c0b4f-openshift-service-ca-bundle\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:51:25.381519 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.381520    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08522f59-643c-4777-b923-3c3a292c0b4f-proxy-tls\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:51:25.819197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.819113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"
Aug 04 18:51:25.819197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.819127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc" event={"ID":"08522f59-643c-4777-b923-3c3a292c0b4f","Type":"ContainerDied","Data":"735d3a6539a25adf986f3114a82bd2794d09b169270d6c04473c430fc32cce86"}
Aug 04 18:51:25.819197 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.819183    2580 scope.go:117] "RemoveContainer" containerID="0dbd64a64b2c787c357cdddb1a3f26cab5a642020cd2fb3db891c8856c2dd9e9"
Aug 04 18:51:25.843754 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.843725    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:51:25.848672 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:25.848648    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-493ba-59c7bfbd4c-f2ddc"]
Aug 04 18:51:26.146259 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:26.146231    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" path="/var/lib/kubelet/pods/08522f59-643c-4777-b923-3c3a292c0b4f/volumes"
Aug 04 18:51:26.825264 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:26.825228    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerID="ef799f8daa7157bdaae08df6a86b81d523df5dd84e0ca8ed0878ba88f65ff812" exitCode=0
Aug 04 18:51:26.825706 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:26.825300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b54w5/must-gather-r4vgz" event={"ID":"d85bfdad-ddd0-4f9f-b301-93c6a6523557","Type":"ContainerDied","Data":"ef799f8daa7157bdaae08df6a86b81d523df5dd84e0ca8ed0878ba88f65ff812"}
Aug 04 18:51:26.825706 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:26.825643    2580 scope.go:117] "RemoveContainer" containerID="ef799f8daa7157bdaae08df6a86b81d523df5dd84e0ca8ed0878ba88f65ff812"
Aug 04 18:51:27.003632 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.003599    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b54w5_must-gather-r4vgz_d85bfdad-ddd0-4f9f-b301-93c6a6523557/gather/0.log"
Aug 04 18:51:27.611233 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.611153    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bh2h8/must-gather-sdlm4"]
Aug 04 18:51:27.611530 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.611518    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba"
Aug 04 18:51:27.611582 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.611531    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba"
Aug 04 18:51:27.611617 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.611581    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="08522f59-643c-4777-b923-3c3a292c0b4f" containerName="switch-graph-493ba"
Aug 04 18:51:27.614149 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.614130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.617081 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.617060    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bh2h8\"/\"openshift-service-ca.crt\""
Aug 04 18:51:27.617178 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.617124    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bh2h8\"/\"kube-root-ca.crt\""
Aug 04 18:51:27.618176 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.618149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bh2h8\"/\"default-dockercfg-7nj45\""
Aug 04 18:51:27.625568 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.625545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bh2h8/must-gather-sdlm4"]
Aug 04 18:51:27.801087 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.801049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3f4578-a560-43e9-8edb-02fbd839eba3-must-gather-output\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.801275 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.801169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrbxj\" (UniqueName: \"kubernetes.io/projected/4a3f4578-a560-43e9-8edb-02fbd839eba3-kube-api-access-wrbxj\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.902350 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.902308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3f4578-a560-43e9-8edb-02fbd839eba3-must-gather-output\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.902923 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.902454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrbxj\" (UniqueName: \"kubernetes.io/projected/4a3f4578-a560-43e9-8edb-02fbd839eba3-kube-api-access-wrbxj\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.902923 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.902666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3f4578-a560-43e9-8edb-02fbd839eba3-must-gather-output\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.912312 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.912287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrbxj\" (UniqueName: \"kubernetes.io/projected/4a3f4578-a560-43e9-8edb-02fbd839eba3-kube-api-access-wrbxj\") pod \"must-gather-sdlm4\" (UID: \"4a3f4578-a560-43e9-8edb-02fbd839eba3\") " pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:27.923455 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:27.923431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bh2h8/must-gather-sdlm4"
Aug 04 18:51:28.054671 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:28.054641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bh2h8/must-gather-sdlm4"]
Aug 04 18:51:28.057875 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:51:28.057850    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a3f4578_a560_43e9_8edb_02fbd839eba3.slice/crio-9762fff3688285d1244708cc830675ce4d84e0824b03417b4bfd7228a109273a WatchSource:0}: Error finding container 9762fff3688285d1244708cc830675ce4d84e0824b03417b4bfd7228a109273a: Status 404 returned error can't find the container with id 9762fff3688285d1244708cc830675ce4d84e0824b03417b4bfd7228a109273a
Aug 04 18:51:28.838812 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:28.838775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bh2h8/must-gather-sdlm4" event={"ID":"4a3f4578-a560-43e9-8edb-02fbd839eba3","Type":"ContainerStarted","Data":"0948c03ec1a00b812c3782061ea519f78bd8d32a5fd9c9c58235126322a8593c"}
Aug 04 18:51:28.838972 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:28.838828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bh2h8/must-gather-sdlm4" event={"ID":"4a3f4578-a560-43e9-8edb-02fbd839eba3","Type":"ContainerStarted","Data":"9762fff3688285d1244708cc830675ce4d84e0824b03417b4bfd7228a109273a"}
Aug 04 18:51:29.847188 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:29.847157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bh2h8/must-gather-sdlm4" event={"ID":"4a3f4578-a560-43e9-8edb-02fbd839eba3","Type":"ContainerStarted","Data":"8eef43841dec987fb8a36250d8156626c69c29f2abd0e05d412beed8f3ca465a"}
Aug 04 18:51:29.874188 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:29.874138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bh2h8/must-gather-sdlm4" podStartSLOduration=2.251105139 podStartE2EDuration="2.874119995s" totalImagesPullingTime="623.014856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:51:29.873650412 +0000 UTC m=+3032.315802702" watchObservedRunningTime="2026-08-04 18:51:29.874119995 +0000 UTC m=+3032.316272337"
Aug 04 18:51:30.259106 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:30.259064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hbnsn_ff9905c6-8e42-4f1c-ae89-030cc80dc053/global-pull-secret-syncer/0.log"
Aug 04 18:51:30.446404 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:30.446358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxzh4_5671e75c-a64c-4b9f-89bc-c5c7e6627d46/konnectivity-agent/0.log"
Aug 04 18:51:30.480480 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:30.480442    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-114.ec2.internal_6b8da014694864829d0e8663a754d2a1/haproxy/0.log"
Aug 04 18:51:32.446282 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.446237    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-b54w5/must-gather-r4vgz"]
Aug 04 18:51:32.446758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.446653    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-b54w5/must-gather-r4vgz" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="copy" containerID="cri-o://8c72ca9a8088741bc7cf5184cc00bc5b03c30cfdf760ae0192388b6fca20d722" gracePeriod=2
Aug 04 18:51:32.453138 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.453099    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-b54w5/must-gather-r4vgz"]
Aug 04 18:51:32.871348 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.871302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b54w5_must-gather-r4vgz_d85bfdad-ddd0-4f9f-b301-93c6a6523557/copy/0.log"
Aug 04 18:51:32.873150 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.871772    2580 generic.go:356] "Generic (PLEG): container finished" podID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerID="8c72ca9a8088741bc7cf5184cc00bc5b03c30cfdf760ae0192388b6fca20d722" exitCode=143
Aug 04 18:51:32.916521 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.916435    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b54w5_must-gather-r4vgz_d85bfdad-ddd0-4f9f-b301-93c6a6523557/copy/0.log"
Aug 04 18:51:32.926061 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:32.925124    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:51:32.928687 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:51:32.928640    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r4vgz\" is forbidden: User \"system:node:ip-10-0-128-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b54w5\": no relationship found between node 'ip-10-0-128-114.ec2.internal' and this object" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:51:33.059765 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.059683    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output\") pod \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") "
Aug 04 18:51:33.061470 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.061431    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d85bfdad-ddd0-4f9f-b301-93c6a6523557" (UID: "d85bfdad-ddd0-4f9f-b301-93c6a6523557"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:51:33.061613 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.061502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ptm6\" (UniqueName: \"kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6\") pod \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\" (UID: \"d85bfdad-ddd0-4f9f-b301-93c6a6523557\") "
Aug 04 18:51:33.061778 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.061758    2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d85bfdad-ddd0-4f9f-b301-93c6a6523557-must-gather-output\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:51:33.072213 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.064416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6" (OuterVolumeSpecName: "kube-api-access-8ptm6") pod "d85bfdad-ddd0-4f9f-b301-93c6a6523557" (UID: "d85bfdad-ddd0-4f9f-b301-93c6a6523557"). InnerVolumeSpecName "kube-api-access-8ptm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:51:33.163082 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.163031    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ptm6\" (UniqueName: \"kubernetes.io/projected/d85bfdad-ddd0-4f9f-b301-93c6a6523557-kube-api-access-8ptm6\") on node \"ip-10-0-128-114.ec2.internal\" DevicePath \"\""
Aug 04 18:51:33.880307 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.880275    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-b54w5_must-gather-r4vgz_d85bfdad-ddd0-4f9f-b301-93c6a6523557/copy/0.log"
Aug 04 18:51:33.880909 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.880699    2580 scope.go:117] "RemoveContainer" containerID="8c72ca9a8088741bc7cf5184cc00bc5b03c30cfdf760ae0192388b6fca20d722"
Aug 04 18:51:33.880909 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.880858    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:51:33.885122 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:51:33.885083    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r4vgz\" is forbidden: User \"system:node:ip-10-0-128-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b54w5\": no relationship found between node 'ip-10-0-128-114.ec2.internal' and this object" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:51:33.893400 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:33.893170    2580 scope.go:117] "RemoveContainer" containerID="ef799f8daa7157bdaae08df6a86b81d523df5dd84e0ca8ed0878ba88f65ff812"
Aug 04 18:51:33.904141 ip-10-0-128-114 kubenswrapper[2580]: E0804 18:51:33.904098    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-r4vgz\" is forbidden: User \"system:node:ip-10-0-128-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-b54w5\": no relationship found between node 'ip-10-0-128-114.ec2.internal' and this object" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" pod="openshift-must-gather-b54w5/must-gather-r4vgz"
Aug 04 18:51:34.150808 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.150354    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" path="/var/lib/kubelet/pods/d85bfdad-ddd0-4f9f-b301-93c6a6523557/volumes"
Aug 04 18:51:34.509028 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.508998    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/alertmanager/0.log"
Aug 04 18:51:34.553906 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.553850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/config-reloader/0.log"
Aug 04 18:51:34.592991 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.592947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/kube-rbac-proxy-web/0.log"
Aug 04 18:51:34.629547 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.629515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/kube-rbac-proxy/0.log"
Aug 04 18:51:34.660954 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.660921    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/kube-rbac-proxy-metric/0.log"
Aug 04 18:51:34.696748 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.696705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/prom-label-proxy/0.log"
Aug 04 18:51:34.735623 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.735596    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc130e23-8969-4fc9-905a-8b35a0dc66e2/init-config-reloader/0.log"
Aug 04 18:51:34.820678 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.820601    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-pv4p7_08832903-a80d-4882-88ab-0ca30ed8c8bc/kube-state-metrics/0.log"
Aug 04 18:51:34.850915 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.850857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-pv4p7_08832903-a80d-4882-88ab-0ca30ed8c8bc/kube-rbac-proxy-main/0.log"
Aug 04 18:51:34.889135 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.889102    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-pv4p7_08832903-a80d-4882-88ab-0ca30ed8c8bc/kube-rbac-proxy-self/0.log"
Aug 04 18:51:34.930067 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.930033    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fdb88df97-pwlcr_36150acf-7745-40b7-af5b-bbfc6f484257/metrics-server/0.log"
Aug 04 18:51:34.966589 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:34.966555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-kr5qn_0ad28d0e-6e35-4e60-8c86-43402c56a845/monitoring-plugin/0.log"
Aug 04 18:51:35.200607 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.200575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8zds_52b22dc0-8f21-4a4a-9e0a-32ee731db4a0/node-exporter/0.log"
Aug 04 18:51:35.239497 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.239466    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8zds_52b22dc0-8f21-4a4a-9e0a-32ee731db4a0/kube-rbac-proxy/0.log"
Aug 04 18:51:35.267927 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.267859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8zds_52b22dc0-8f21-4a4a-9e0a-32ee731db4a0/init-textfile/0.log"
Aug 04 18:51:35.311056 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.311022    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mh9mt_e947580c-4029-474a-9838-9004b60758fa/kube-rbac-proxy-main/0.log"
Aug 04 18:51:35.343610 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.343573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mh9mt_e947580c-4029-474a-9838-9004b60758fa/kube-rbac-proxy-self/0.log"
Aug 04 18:51:35.373881 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.373849    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mh9mt_e947580c-4029-474a-9838-9004b60758fa/openshift-state-metrics/0.log"
Aug 04 18:51:35.422231 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.422200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/prometheus/0.log"
Aug 04 18:51:35.442556 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.442523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/config-reloader/0.log"
Aug 04 18:51:35.469952 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.469919    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/thanos-sidecar/0.log"
Aug 04 18:51:35.497274 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.497244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/kube-rbac-proxy-web/0.log"
Aug 04 18:51:35.534910 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.534866    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/kube-rbac-proxy/0.log"
Aug 04 18:51:35.565372 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.565312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/kube-rbac-proxy-thanos/0.log"
Aug 04 18:51:35.595542 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.595510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_be05d5b3-b0c4-491b-8ee0-f8218b59aa75/init-config-reloader/0.log"
Aug 04 18:51:35.631629 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.631555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-q2gxw_10994d0c-26d7-4d05-8f7c-38e19751a2d5/prometheus-operator/0.log"
Aug 04 18:51:35.661761 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.661705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-q2gxw_10994d0c-26d7-4d05-8f7c-38e19751a2d5/kube-rbac-proxy/0.log"
Aug 04 18:51:35.732637 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.732536    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb88f68f5-4q77c_0cabc3d9-2186-448d-a6d3-fd373d53b0b0/telemeter-client/0.log"
Aug 04 18:51:35.770449 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.770406    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb88f68f5-4q77c_0cabc3d9-2186-448d-a6d3-fd373d53b0b0/reload/0.log"
Aug 04 18:51:35.817729 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.817705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb88f68f5-4q77c_0cabc3d9-2186-448d-a6d3-fd373d53b0b0/kube-rbac-proxy/0.log"
Aug 04 18:51:35.879986 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.879959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/thanos-query/0.log"
Aug 04 18:51:35.936408 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.936378    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/kube-rbac-proxy-web/0.log"
Aug 04 18:51:35.968368 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:35.968336    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/kube-rbac-proxy/0.log"
Aug 04 18:51:36.013769 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:36.013741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/prom-label-proxy/0.log"
Aug 04 18:51:36.044811 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:36.044658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/kube-rbac-proxy-rules/0.log"
Aug 04 18:51:36.081226 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:36.081194    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4bb6d66d-kqhp9_9c5ebdca-1a2a-4210-857d-8d3613482297/kube-rbac-proxy-metrics/0.log"
Aug 04 18:51:38.237551 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:38.237521    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644fcc4454-d8swm_d961718b-664b-49e0-9bbb-ef0003fd2472/console/0.log"
Aug 04 18:51:39.897179 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.897147    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p2gds_513bc62b-9ef4-4752-b2f6-b642f7e9eae9/dns/0.log"
Aug 04 18:51:39.924843 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.924818    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p2gds_513bc62b-9ef4-4752-b2f6-b642f7e9eae9/kube-rbac-proxy/0.log"
Aug 04 18:51:39.952725 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.952531    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"]
Aug 04 18:51:39.953166 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="gather"
Aug 04 18:51:39.953363 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953341    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="gather"
Aug 04 18:51:39.953363 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953371    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="copy"
Aug 04 18:51:39.953543 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953381    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="copy"
Aug 04 18:51:39.953543 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953482    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="gather"
Aug 04 18:51:39.953543 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.953501    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85bfdad-ddd0-4f9f-b301-93c6a6523557" containerName="copy"
Aug 04 18:51:39.958712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.958694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:39.975601 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:39.975575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"]
Aug 04 18:51:40.038180 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.038139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-proc\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.038453 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.038430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-759k8\" (UniqueName: \"kubernetes.io/projected/c6a4df3c-932f-408c-8393-eea31482fcb5-kube-api-access-759k8\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.038633 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.038614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-sys\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.038773 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.038756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-lib-modules\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.038930 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.038915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-podres\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.071897 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.071859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whsbv_6468326b-f7ea-4a7f-8b90-672a176e226d/dns-node-resolver/0.log"
Aug 04 18:51:40.140510 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-sys\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-lib-modules\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-podres\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-sys\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-proc\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-proc\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-podres\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6a4df3c-932f-408c-8393-eea31482fcb5-lib-modules\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.140758 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.140726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-759k8\" (UniqueName: \"kubernetes.io/projected/c6a4df3c-932f-408c-8393-eea31482fcb5-kube-api-access-759k8\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.151126 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.151054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-759k8\" (UniqueName: \"kubernetes.io/projected/c6a4df3c-932f-408c-8393-eea31482fcb5-kube-api-access-759k8\") pod \"perf-node-gather-daemonset-l7sbf\" (UID: \"c6a4df3c-932f-408c-8393-eea31482fcb5\") " pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.269993 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.269939    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.425438 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.425330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"]
Aug 04 18:51:40.427861 ip-10-0-128-114 kubenswrapper[2580]: W0804 18:51:40.427828    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6a4df3c_932f_408c_8393_eea31482fcb5.slice/crio-580aa490bd45900f2546ca40b3121b495b494a7433aeef36046ed9ad96e30cbd WatchSource:0}: Error finding container 580aa490bd45900f2546ca40b3121b495b494a7433aeef36046ed9ad96e30cbd: Status 404 returned error can't find the container with id 580aa490bd45900f2546ca40b3121b495b494a7433aeef36046ed9ad96e30cbd
Aug 04 18:51:40.630643 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.630613    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5q72_00d51c67-94ff-4aa2-8eb1-5de80210655c/node-ca/0.log"
Aug 04 18:51:40.922712 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.922679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf" event={"ID":"c6a4df3c-932f-408c-8393-eea31482fcb5","Type":"ContainerStarted","Data":"17c6e016b289a25438717b1e5d128fca3ca0331dac3dc1fd8dc705d88b7a554a"}
Aug 04 18:51:40.923128 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.922729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf" event={"ID":"c6a4df3c-932f-408c-8393-eea31482fcb5","Type":"ContainerStarted","Data":"580aa490bd45900f2546ca40b3121b495b494a7433aeef36046ed9ad96e30cbd"}
Aug 04 18:51:40.923128 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.922800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:40.941518 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:40.941449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf" podStartSLOduration=1.941428191 podStartE2EDuration="1.941428191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:51:40.940355182 +0000 UTC m=+3043.382507473" watchObservedRunningTime="2026-08-04 18:51:40.941428191 +0000 UTC m=+3043.383580482"
Aug 04 18:51:41.852219 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:41.852189    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qb6kl_fbe1a185-70e9-4745-9177-f2de5ebf0685/serve-healthcheck-canary/0.log"
Aug 04 18:51:42.307551 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:42.307526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56nzp_936654ff-ba14-4133-ba13-5567e5b4ed8f/kube-rbac-proxy/0.log"
Aug 04 18:51:42.332855 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:42.332820    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56nzp_936654ff-ba14-4133-ba13-5567e5b4ed8f/exporter/0.log"
Aug 04 18:51:42.359989 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:42.359957    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-56nzp_936654ff-ba14-4133-ba13-5567e5b4ed8f/extractor/0.log"
Aug 04 18:51:45.068047 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:45.068008    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-8588677cfb-59frw_7264abcb-8425-4404-9164-6e30027dbf64/manager/0.log"
Aug 04 18:51:45.118453 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:45.118424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6f9qw_7784a43a-0510-4dc0-8938-492fcf752eda/s3-init/0.log"
Aug 04 18:51:45.140129 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:45.140101    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6f9qw_7784a43a-0510-4dc0-8938-492fcf752eda/download-hf-model/0.log"
Aug 04 18:51:46.940285 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:46.940256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bh2h8/perf-node-gather-daemonset-l7sbf"
Aug 04 18:51:51.450567 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.450534    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/kube-multus-additional-cni-plugins/0.log"
Aug 04 18:51:51.488998 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.488973    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/egress-router-binary-copy/0.log"
Aug 04 18:51:51.520984 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.520950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/cni-plugins/0.log"
Aug 04 18:51:51.551196 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.551115    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/bond-cni-plugin/0.log"
Aug 04 18:51:51.581685 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.581657    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/routeoverride-cni/0.log"
Aug 04 18:51:51.610237 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.610209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/whereabouts-cni-bincopy/0.log"
Aug 04 18:51:51.638370 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.638340    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dhw2_7ff1ef1e-d99e-4333-9d9c-243c0a09df12/whereabouts-cni/0.log"
Aug 04 18:51:51.886401 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:51.886370    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k6bww_0e0f3ac3-6af0-4e9f-aabe-7336108473b3/kube-multus/0.log"
Aug 04 18:51:52.063405 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:52.063361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wfgkp_9a31bcc0-fe38-4c6a-bd83-a3131e3be390/network-metrics-daemon/0.log"
Aug 04 18:51:52.086855 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:52.086827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wfgkp_9a31bcc0-fe38-4c6a-bd83-a3131e3be390/kube-rbac-proxy/0.log"
Aug 04 18:51:52.929547 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:52.929515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/ovn-controller/0.log"
Aug 04 18:51:52.951420 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:52.951390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/ovn-acl-logging/0.log"
Aug 04 18:51:52.979870 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:52.979837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/kube-rbac-proxy-node/0.log"
Aug 04 18:51:53.007237 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:53.007204    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/kube-rbac-proxy-ovn-metrics/0.log"
Aug 04 18:51:53.031553 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:53.031523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/northd/0.log"
Aug 04 18:51:53.058859 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:53.058826    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/nbdb/0.log"
Aug 04 18:51:53.084161 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:53.084133    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/sbdb/0.log"
Aug 04 18:51:53.147827 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:53.147791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-czvw8_e7f52a46-bea7-4d80-b589-d55ab394609b/ovnkube-controller/0.log"
Aug 04 18:51:54.720801 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:54.720773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fsgwg_4dee438b-8cda-422f-9b89-4e1dada12df9/network-check-target-container/0.log"
Aug 04 18:51:55.931579 ip-10-0-128-114 kubenswrapper[2580]: I0804 18:51:55.931545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xp4v2_faa59f9e-f492-4ac4-931c-f0e168bcc7e6/iptables-alerter/0.log"