May 26 15:58:01.352177 ip-10-0-137-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 15:58:01.352187 ip-10-0-137-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 15:58:01.352194 ip-10-0-137-117 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 15:58:01.352411 ip-10-0-137-117 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 15:58:11.417064 ip-10-0-137-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 15:58:11.417083 ip-10-0-137-117 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 54c80499e06047a99294bb0c31167a6a --
May 26 16:00:38.346148 ip-10-0-137-117 systemd[1]: Starting Kubernetes Kubelet...
May 26 16:00:38.842680 ip-10-0-137-117 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:00:38.842680 ip-10-0-137-117 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 16:00:38.842680 ip-10-0-137-117 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:00:38.842680 ip-10-0-137-117 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 16:00:38.842680 ip-10-0-137-117 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:00:38.844488 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.844392    2547 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 16:00:38.851407 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851390    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:00:38.851407 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851405    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:00:38.851407 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851410    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:00:38.851407 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851414    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851418    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851423    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851427    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851431    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851436    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851439    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851443    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851447    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851450    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851454    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851458    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851462    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851466    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851469    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851473    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851479    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851483    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851486    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:00:38.851648 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851490    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851504    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851511    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851515    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851520    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851524    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851528    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851533    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851538    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851542    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851546    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851550    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851557    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851562    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851567    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851572    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851577    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851581    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851586    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:00:38.852428 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851590    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851594    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851600    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851604    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851608    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851612    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851617    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851622    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851627    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851631    2547 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851636    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851640    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851644    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851648    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851653    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851657    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851661    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851666    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851670    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851674    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:00:38.853119 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851678    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851682    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851686    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851691    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851695    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851701    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851705    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851709    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851715    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851720    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851724    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851728    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851733    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851738    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851743    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851747    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851752    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851756    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851760    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851765    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:00:38.853619 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851769    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851773    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851777    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851781    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.851785    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852394    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852404    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852408    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852413    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852418    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852423    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852426    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852430    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852435    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852439    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852443    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852447    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852451    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852455    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852460    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852464    2547 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:00:38.854153 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852468    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852472    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852477    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852481    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852487    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852491    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852495    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852499    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852503    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852510    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852516    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852521    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852525    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852531    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852536    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852540    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852545    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852550    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852554    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:00:38.854674 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852558    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852562    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852567    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852571    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852575    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852579    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852583    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852587    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852592    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852596    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852600    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852604    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852609    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852613    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852617    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852621    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852625    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852630    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852637    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852641    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:00:38.855513 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852646    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852650    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852654    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852658    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852662    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852666    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852671    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852676    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852680    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852684    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852688    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852692    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852697    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852701    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852706    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852714    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852719    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852723    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852727    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:00:38.856301 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852731    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852735    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852740    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852746    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852750    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852754    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852758    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852762    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852767    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852771    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852775    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.852779    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854673    2547 flags.go:64] FLAG: --address="0.0.0.0"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854690    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854700    2547 flags.go:64] FLAG: --anonymous-auth="true"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854708    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854715    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854719    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854727    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854734    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854739    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 16:00:38.856765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854744    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854749    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854755    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854760    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854765    2547 flags.go:64] FLAG: --cgroup-root=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854769    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854774    2547 flags.go:64] FLAG: --client-ca-file=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854779    2547 flags.go:64] FLAG: --cloud-config=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854785    2547 flags.go:64] FLAG: --cloud-provider="external"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854790    2547 flags.go:64] FLAG: --cluster-dns="[]"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854797    2547 flags.go:64] FLAG: --cluster-domain=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854802    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854807    2547 flags.go:64] FLAG: --config-dir=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854811    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854817    2547 flags.go:64] FLAG: --container-log-max-files="5"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854823    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854828    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854834    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854839    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854844    2547 flags.go:64] FLAG: --contention-profiling="false"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854849    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854854    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854859    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854864    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854886    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 16:00:38.857421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854892    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854897    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854901    2547 flags.go:64] FLAG: --enable-load-reader="false"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854906    2547 flags.go:64] FLAG: --enable-server="true"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854911    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854918    2547 flags.go:64] FLAG: --event-burst="100"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854923    2547 flags.go:64] FLAG: --event-qps="50"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854928    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854933    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854938    2547 flags.go:64] FLAG: --eviction-hard=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854955    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854960    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854965    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854970    2547 flags.go:64] FLAG: --eviction-soft=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854975    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854980    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854985    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854990    2547 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.854995    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855000    2547 flags.go:64] FLAG: --fail-swap-on="true"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855005    2547 flags.go:64] FLAG: --feature-gates=""
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855012    2547 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855017    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855022    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855027    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855033    2547 flags.go:64] FLAG: --healthz-port="10248"
May 26 16:00:38.858148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855038    2547 flags.go:64] FLAG: --help="false"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855043    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-137-117.ec2.internal"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855049    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855054    2547 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855059    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855065    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855072    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855077    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855082    2547 flags.go:64] FLAG: --image-service-endpoint=""
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855087    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855092    2547 flags.go:64] FLAG: --kube-api-burst="100"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855097    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855103    2547 flags.go:64] FLAG: --kube-api-qps="50"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855107    2547 flags.go:64] FLAG: --kube-reserved=""
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855113    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855118    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855123    2547 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855128    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855133    2547 flags.go:64] FLAG: --lock-file=""
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855138    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855143    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855148    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855158    2547 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 16:00:38.858999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855163    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855168    2547 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855173    2547 flags.go:64] FLAG: --logging-format="text"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855178    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855183    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855188    2547 flags.go:64] FLAG: --manifest-url=""
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855193    2547 flags.go:64] FLAG: --manifest-url-header=""
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855200    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855206    2547 flags.go:64] FLAG: --max-open-files="1000000"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855212    2547 flags.go:64] FLAG: --max-pods="110"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855217    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855222    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855227    2547 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855232    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855237    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855242    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855248    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855260    2547 flags.go:64] FLAG: --node-status-max-images="50"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855265    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855270    2547 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855275    2547 flags.go:64] FLAG: --pod-cidr=""
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855280    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855289    2547 flags.go:64] FLAG: --pod-manifest-path=""
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855294    2547 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 16:00:38.859631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855299    2547 flags.go:64] FLAG: --pods-per-core="0"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855305    2547 flags.go:64] FLAG: --port="10250"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855309    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855315    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0848b41de756cf68e"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855320    2547 flags.go:64] FLAG: --qos-reserved=""
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855326    2547 flags.go:64] FLAG: --read-only-port="10255"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855331    2547 flags.go:64] FLAG: --register-node="true"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855336    2547 flags.go:64] FLAG: --register-schedulable="true"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855341    2547 flags.go:64] FLAG: --register-with-taints=""
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855347    2547 flags.go:64] FLAG: --registry-burst="10"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855352    2547 flags.go:64] FLAG: --registry-qps="5"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855356    2547 flags.go:64] FLAG: --reserved-cpus=""
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855361    2547 flags.go:64] FLAG: --reserved-memory=""
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855367    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855372    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855377    2547 flags.go:64] FLAG: --rotate-certificates="false"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855383    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855387    2547 flags.go:64] FLAG: --runonce="false"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855392    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855398    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855406    2547 flags.go:64] FLAG: --seccomp-default="false"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855411    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855416    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855422    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855427    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855433    2547 flags.go:64] FLAG: --storage-driver-password="root"
May 26 16:00:38.860320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855438    2547 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855443    2547 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855448    2547 flags.go:64] FLAG: --storage-driver-user="root"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855453    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855459    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855464    2547 flags.go:64] FLAG: --system-cgroups=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855468    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855482    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855487    2547 flags.go:64] FLAG: --tls-cert-file=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855492    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855499    2547 flags.go:64] FLAG: --tls-min-version=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855504    2547 flags.go:64] FLAG: --tls-private-key-file=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855508    2547 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855513    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855518    2547 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855522    2547 flags.go:64] FLAG: --v="2"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855528    2547 flags.go:64] FLAG: --version="false"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855534    2547 flags.go:64] FLAG: --vmodule=""
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855541    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.855546    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855721    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855728    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855733    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855737    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:00:38.861006 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855742    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855746    2547 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855753    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855758    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855762    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855767    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855772    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855776    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855781    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855786    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855792    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855796    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855800    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855804    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855808    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855813    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855817    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855821    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855827    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855834    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:00:38.861614 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855839    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855842    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855847    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855851    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855856    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855860    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855864    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855869    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855892    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855896    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855900    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855904    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855908    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855912    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855919    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855923    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855927    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855931    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855935    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855940    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:00:38.862155 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855944    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855949    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855955    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855959    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855963    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855967    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855972    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855976    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855980    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855985    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855989    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855993    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.855997    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856002    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856006    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856010    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856015    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856019    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856023    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:00:38.862637 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856027    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856031    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856035    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856039    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856043    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856048    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856052    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856058    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856064    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856070    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856075    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856080    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856084    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856089    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856093    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856098    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856102    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856106    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856111    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856115    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:00:38.863174 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856120    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:00:38.863663 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856125    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:00:38.863663 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.856129    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:00:38.863663 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.857085    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:00:38.866142 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.866124    2547 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 16:00:38.866182 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.866143    2547 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 16:00:38.866213 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866200    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:00:38.866213 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866206    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:00:38.866213 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866209    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:00:38.866213 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866212    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866217    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866222    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866225    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866228    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866231    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866234    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866237    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866240    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866243    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866245    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866248    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866251    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866253    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866256    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866258    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866261    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866263    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866266    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:00:38.866316 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866269    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866271    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866274    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866276    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866279    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866283    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866286    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866289    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866291    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866295    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866298    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866300    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866303    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866306    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866308    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866312    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866314    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866317    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866320    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:00:38.866817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866323    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866326    2547 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866328    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866331    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866333    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866336    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866338    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866341    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866344    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866346    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866349    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866351    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866354    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866356    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866359    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866361    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866364    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866367    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866369    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866372    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:00:38.867412 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866375    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866378    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866380    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866383    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866386    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866388    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866391    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866394    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866397    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866399    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866402    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866405    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866407    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866410    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866412    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866415    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866418    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866420    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866423    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866425    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:00:38.867919 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866428    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866430    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866433    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866436    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866439    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.866444    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866546    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866551    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866554    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866557    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866560    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866563    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866566    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866569    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866572    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866575    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:00:38.868406 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866578    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866581    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866583    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866586    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866588    2547 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866591    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866594    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866597    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866599    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866602    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866605    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866608    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866610    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866613    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866615    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866618    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866620    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866623    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866626    2547 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866629    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:00:38.868801 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866631    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866634    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866636    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866639    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866641    2547 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866644    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866646    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866649    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866652    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866654    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866658    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866662    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866665    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866669    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866671    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866674    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866678    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866681    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866685    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866687    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:00:38.869310 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866690    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866693    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866695    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866698    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866701    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866703    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866706    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866708    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866710    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866713    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866716    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866718    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866721    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866723    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866726    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866728    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866731    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866733    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866736    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866738    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:00:38.869791 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866741    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866743    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866746    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866748    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866751    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866754    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866758    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866762    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866764    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866768    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866770    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866773    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866775    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866777    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866780    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:00:38.870326 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:38.866782    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:00:38.870687 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.866787    2547 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:00:38.870687 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.867770    2547 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 16:00:38.870687 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.870206    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 16:00:38.871309 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.871297    2547 server.go:1019] "Starting client certificate rotation"
May 26 16:00:38.871405 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.871389    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:00:38.871442 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.871425    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:00:38.899851 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.899834    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:00:38.905310 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.905287    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:00:38.925036 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.925016    2547 log.go:25] "Validated CRI v1 runtime API"
May 26 16:00:38.932480 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.932464    2547 log.go:25] "Validated CRI v1 image API"
May 26 16:00:38.934010 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.933995    2547 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 16:00:38.936709 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.936678    2547 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a6b7a5d-866f-4066-840e-97165aebaf8e:/dev/nvme0n1p4 f9751615-f464-4a42-a4a1-98b611b03ae5:/dev/nvme0n1p3]
May 26 16:00:38.936762 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.936709    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 16:00:38.940953 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.940808    2547 manager.go:217] Machine: {Timestamp:2026-05-26 16:00:38.940309804 +0000 UTC m=+0.462891840 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102264 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20768cb889da771f3ec2faaf871952 SystemUUID:ec20768c-b889-da77-1f3e-c2faaf871952 BootID:54c80499-e060-47a9-9294-bb0c31167a6a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:21:84:1f:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:21:84:1f:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:96:bc:34:20:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 16:00:38.940953 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.940945    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 16:00:38.941078 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.941026    2547 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 16:00:38.942436 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.942418    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:00:38.943986 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.943964    2547 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 16:00:38.944142 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.943990    2547 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 16:00:38.944191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.944152    2547 topology_manager.go:138] "Creating topology manager with none policy"
May 26 16:00:38.944191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.944160    2547 container_manager_linux.go:306] "Creating device plugin manager"
May 26 16:00:38.944191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.944171    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:00:38.945156 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.945146    2547 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:00:38.947797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.947786    2547 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:00:38.947921 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.947912    2547 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 16:00:38.950612 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.950601    2547 kubelet.go:491] "Attempting to sync node with API server"
May 26 16:00:38.950654 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.950618    2547 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 16:00:38.950654 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.950631    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 16:00:38.950654 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.950640    2547 kubelet.go:397] "Adding apiserver pod source"
May 26 16:00:38.950654 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.950648    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 16:00:38.952000 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.951986    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:00:38.952054 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.952010    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:00:38.955783 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.955765    2547 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 16:00:38.960050 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.960029    2547 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961107    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961129    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961139    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961149    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961162    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961172    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961183    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961192    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961207    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961221    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 16:00:38.961523 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961234    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 16:00:38.962010 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.961665    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 16:00:38.962806 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.962791    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 16:00:38.962847 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.962838    2547 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 16:00:38.964952 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.964926    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 16:00:38.964952 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.964937    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 16:00:38.966155 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.966139    2547 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 16:00:38.966208 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.966178    2547 server.go:1295] "Started kubelet"
May 26 16:00:38.966268 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.966244    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 16:00:38.966350 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.966292    2547 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 16:00:38.966402 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.966375    2547 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 16:00:38.966931 ip-10-0-137-117 systemd[1]: Started Kubernetes Kubelet.
May 26 16:00:38.967985 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.967955    2547 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 16:00:38.968191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.968180    2547 server.go:317] "Adding debug handlers to kubelet server"
May 26 16:00:38.970762 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.970742    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzl6p"
May 26 16:00:38.973428 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.973412    2547 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 16:00:38.973958 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.972913    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-117.ec2.internal.18b328e459d352b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-117.ec2.internal,UID:ip-10-0-137-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-117.ec2.internal,},FirstTimestamp:2026-05-26 16:00:38.966153908 +0000 UTC m=+0.488735943,LastTimestamp:2026-05-26 16:00:38.966153908 +0000 UTC m=+0.488735943,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-117.ec2.internal,}"
May 26 16:00:38.975912 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.975896    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 16:00:38.975986 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.975965    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 16:00:38.976048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976034    2547 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 16:00:38.976048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976045    2547 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 16:00:38.976145 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976139    2547 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 16:00:38.976270 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976224    2547 reconstruct.go:97] "Volume reconstruction finished"
May 26 16:00:38.976270 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976237    2547 reconciler.go:26] "Reconciler: start to sync state"
May 26 16:00:38.976644 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976627    2547 factory.go:55] Registering systemd factory
May 26 16:00:38.976735 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976676    2547 factory.go:223] Registration of the systemd container factory successfully
May 26 16:00:38.976735 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.976722    2547 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 16:00:38.976927 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976910    2547 factory.go:153] Registering CRI-O factory
May 26 16:00:38.976927 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976928    2547 factory.go:223] Registration of the crio container factory successfully
May 26 16:00:38.977052 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976977    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 16:00:38.977052 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.976997    2547 factory.go:103] Registering Raw factory
May 26 16:00:38.977052 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.977005    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:38.977052 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.977012    2547 manager.go:1196] Started watching for new ooms in manager
May 26 16:00:38.977510 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.977496    2547 manager.go:319] Starting recovery of all containers
May 26 16:00:38.980348 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.980326    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzl6p"
May 26 16:00:38.982979 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.982952    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 16:00:38.983128 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:38.983106    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 16:00:38.988057 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.987815    2547 manager.go:324] Recovery completed
May 26 16:00:38.993108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.993095    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:38.994781 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.994765    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:38.994843 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.994794    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:38.994843 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.994806    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:38.995476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.995461    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 16:00:38.995476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.995474    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 16:00:38.995573 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.995488    2547 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:00:38.999431 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.999419    2547 policy_none.go:49] "None policy: Start"
May 26 16:00:38.999471 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.999437    2547 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 16:00:38.999471 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:38.999448    2547 state_mem.go:35] "Initializing new in-memory state store"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045402    2547 manager.go:341] "Starting Device Plugin manager"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.045435    2547 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045446    2547 server.go:85] "Starting device plugin registration server"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045678    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045695    2547 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045813    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045922    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.045933    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.046399    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 16:00:39.058476 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.046440    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.108957 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.108920    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 16:00:39.110153 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.110140    2547 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 16:00:39.110208 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.110159    2547 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 16:00:39.110208 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.110180    2547 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 16:00:39.110208 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.110186    2547 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 16:00:39.110332 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.110222    2547 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 16:00:39.117331 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.117313    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:00:39.146476 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.146457    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:39.147242 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.147227    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:39.147317 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.147257    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:39.147317 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.147268    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:39.147317 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.147290    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-117.ec2.internal"
May 26 16:00:39.161786 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.161769    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-117.ec2.internal"
May 26 16:00:39.161833 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.161791    2547 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-117.ec2.internal\": node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.179789 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.179769    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.210348 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.210320    2547 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"]
May 26 16:00:39.210402 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.210389    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:39.211155 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.211133    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:39.211220 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.211158    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:39.211220 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.211168    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:39.212362 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.212351    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:39.212530 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.212514    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.212568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.212546    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:39.213043 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213028    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:39.213104 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213057    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:39.213104 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213068    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:39.213166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213028    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:39.213166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213127    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:39.213166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.213140    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:39.214051 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.214035    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.214125 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.214059    2547 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:00:39.214657 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.214644    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:00:39.214724 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.214669    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:00:39.214724 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.214679    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
May 26 16:00:39.245477 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.245456    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-117.ec2.internal\" not found" node="ip-10-0-137-117.ec2.internal"
May 26 16:00:39.249740 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.249723    2547 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-117.ec2.internal\" not found" node="ip-10-0-137-117.ec2.internal"
May 26 16:00:39.277829 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.277809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.277925 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.277833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.277925 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.277850    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/526f86543568486463bfd1c4f84c7011-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"526f86543568486463bfd1c4f84c7011\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.279849 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.279833    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.378315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378244    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.378315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378274    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.378315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378290    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/526f86543568486463bfd1c4f84c7011-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"526f86543568486463bfd1c4f84c7011\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.378498 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378350    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.378498 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378379    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5455bca543c3da4894337d6f1e9c5338-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"5455bca543c3da4894337d6f1e9c5338\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.378498 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.378358    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/526f86543568486463bfd1c4f84c7011-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"526f86543568486463bfd1c4f84c7011\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.380346 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.380330    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.481162 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.481115    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.548315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.548281    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.552002 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.551984    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.582010 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.581984    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.682477 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.682450    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.782935 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.782908    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.872157 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.872112    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 16:00:39.872693 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.872270    2547 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:00:39.883561 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:39.883537    2547 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
May 26 16:00:39.953333 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.953275    2547 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:00:39.961171 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.961150    2547 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:00:39.976769 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.976738    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.976769 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.976761    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 16:00:39.982510 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.982473    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:55:38 +0000 UTC" deadline="2028-01-17 00:01:06.750925821 +0000 UTC"
May 26 16:00:39.982510 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.982502    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14408h0m26.768427804s"
May 26 16:00:39.988528 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.988512    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:00:39.989710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.989695    2547 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
May 26 16:00:39.991307 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:39.991289    2547 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:00:40.001209 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.001193    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:00:40.015594 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.015573    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7sqqw"
May 26 16:00:40.026886 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.026855    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7sqqw"
May 26 16:00:40.121534 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:40.121497    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526f86543568486463bfd1c4f84c7011.slice/crio-d3562a69c70b4d7ea6f9bf1dcaec8eefbfa42a40487ef52f12589a4e0bf76e70 WatchSource:0}: Error finding container d3562a69c70b4d7ea6f9bf1dcaec8eefbfa42a40487ef52f12589a4e0bf76e70: Status 404 returned error can't find the container with id d3562a69c70b4d7ea6f9bf1dcaec8eefbfa42a40487ef52f12589a4e0bf76e70
May 26 16:00:40.121722 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:40.121703    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5455bca543c3da4894337d6f1e9c5338.slice/crio-bd7281792abf0b7cae88978a53858238ec770643a7e7176fd17422c9f6a0caf3 WatchSource:0}: Error finding container bd7281792abf0b7cae88978a53858238ec770643a7e7176fd17422c9f6a0caf3: Status 404 returned error can't find the container with id bd7281792abf0b7cae88978a53858238ec770643a7e7176fd17422c9f6a0caf3
May 26 16:00:40.126833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.126467    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:00:40.216393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.216311    2547 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:00:40.952535 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.952496    2547 apiserver.go:52] "Watching apiserver"
May 26 16:00:40.959920 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.959898    2547 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 16:00:40.961063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.961039    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal","openshift-multus/network-metrics-daemon-87r2b","openshift-network-diagnostics/network-check-target-jtfd5","openshift-ovn-kubernetes/ovnkube-node-qbhwc","kube-system/konnectivity-agent-8qslp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s","openshift-cluster-node-tuning-operator/tuned-p9pmk","openshift-image-registry/node-ca-htshq","openshift-multus/multus-9vnsh","openshift-multus/multus-additional-cni-plugins-wd95r","openshift-network-operator/iptables-alerter-kb4mk"]
May 26 16:00:40.965450 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.965427    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:40.965565 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:40.965513    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:40.965565 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.965531    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:40.965748 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:40.965723    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:40.967579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.967561    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969620    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969652    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969652    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969809    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969842    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gpv87\""
May 26 16:00:40.970108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.969905    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 16:00:40.970430 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.970216    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 16:00:40.972039 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.971993    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:40.972139 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.972094    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.974263 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.974221    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.975123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.974963    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 16:00:40.975123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975018    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 16:00:40.975123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975063    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5rtx7\""
May 26 16:00:40.975123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975096    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 16:00:40.975123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975120    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 16:00:40.975343 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975021    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 16:00:40.975410 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.975394    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ph77n\""
May 26 16:00:40.976048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.976029    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 16:00:40.976316 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.976302    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8rxjf\""
May 26 16:00:40.976811 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.976461    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 16:00:40.980290 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.979814    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:40.982638 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.982592    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.984608 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.984457    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 16:00:40.985467 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.984944    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 16:00:40.985467 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.985009    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:40.985467 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.985016    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:40.985467 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.985264    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 16:00:40.985704 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.985626    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7cdd2\""
May 26 16:00:40.986451 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986142    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-slash\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.986552 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986480    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-bin\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.986552 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-script-lib\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.986552 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986533    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-systemd\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986556    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986580    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-bin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986606    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdv8\" (UniqueName: \"kubernetes.io/projected/c3b148e7-c1e0-4215-8370-7707e59cbba2-kube-api-access-nxdv8\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-var-lib-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986654    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d167638b-6e24-4f22-b09f-0586d64d5475-ovn-node-metrics-cert\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986677    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-kubernetes\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.986700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986699    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-conf\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986722    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97bmp\" (UniqueName: \"kubernetes.io/projected/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-kube-api-access-97bmp\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986744    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-node-log\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986767    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-systemd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986790    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-var-lib-kubelet\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986813    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-netns\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986836    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-kubelet\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.987283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.986861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hck\" (UniqueName: \"kubernetes.io/projected/d167638b-6e24-4f22-b09f-0586d64d5475-kube-api-access-t9hck\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987343    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c76d123-bcd8-44b8-a985-af7f30cc6c50-agent-certs\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987395    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-log-socket\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987419    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-kubelet\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987444    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-modprobe-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987468    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-run\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987494    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-k8s-cni-cncf-io\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987550    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-netd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987572    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-sys\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-host\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.987606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-serviceca\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987624    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-hostroot\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-daemon-config\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987670    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987716    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-tmp\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987806    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cnibin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987900    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.987995    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9twv\" (UniqueName: \"kubernetes.io/projected/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-kube-api-access-m9twv\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988036    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-multus-certs\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988101    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-netns\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.988186 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988187    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-socket-dir-parent\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988215    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988239    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-systemd-units\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988316    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988347    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-host\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-system-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988395    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-etc-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988444    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-device-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988477    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28x4\" (UniqueName: \"kubernetes.io/projected/e0790561-7d53-4555-a7cb-a92a7e7172c3-kube-api-access-l28x4\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988504    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-tuned\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988531    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-os-release\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988563    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988589    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-config\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988612    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-env-overrides\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988639    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988651    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 16:00:40.988725 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988686    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c76d123-bcd8-44b8-a985-af7f30cc6c50-konnectivity-ca\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988710    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-etc-kubernetes\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988735    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-ovn\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988760    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysconfig\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988786    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cni-binary-copy\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988812    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-conf-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988835    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-lib-modules\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988868    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmtm\" (UniqueName: \"kubernetes.io/projected/51ed80e2-6df4-44c4-904c-70d88d7787ea-kube-api-access-whmtm\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988899    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988906    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-multus\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.988966    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bfhgh\""
May 26 16:00:40.989439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.989101    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 16:00:40.991080 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.990946    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 16:00:40.991438 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.991325    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 16:00:40.991672 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.991653    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 16:00:40.991672 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.991668    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 16:00:40.992234 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.992211    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5g6jj\""
May 26 16:00:40.993621 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:40.993559    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lmwtw\""
May 26 16:00:41.001485 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.001465    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 16:00:41.027618 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.027593    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:55:40 +0000 UTC" deadline="2027-11-04 10:07:39.290176181 +0000 UTC"
May 26 16:00:41.027618 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.027617    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12642h6m58.262561513s"
May 26 16:00:41.077140 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.077115    2547 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 16:00:41.089295 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089271    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-lib-modules\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.089416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089307    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmtm\" (UniqueName: \"kubernetes.io/projected/51ed80e2-6df4-44c4-904c-70d88d7787ea-kube-api-access-whmtm\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.089416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089330    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-multus\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.089416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089358    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.089416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089378    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c833574-e765-4413-a2c6-76583f01a26a-iptables-alerter-script\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.089416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089393    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-slash\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089416    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-bin\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089473    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-script-lib\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089483    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-slash\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089485    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-multus\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089486    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-lib-modules\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.089623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089533    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-bin\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.089865 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.089514    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-systemd\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090102    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-systemd\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090205    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090260    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-bin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090308    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdv8\" (UniqueName: \"kubernetes.io/projected/c3b148e7-c1e0-4215-8370-7707e59cbba2-kube-api-access-nxdv8\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090331    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-var-lib-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090371    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d167638b-6e24-4f22-b09f-0586d64d5475-ovn-node-metrics-cert\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090398    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-cni-bin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090423    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-kubernetes\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090472    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-conf\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090514    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97bmp\" (UniqueName: \"kubernetes.io/projected/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-kube-api-access-97bmp\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090521    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-kubernetes\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090563    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-node-log\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090591    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-var-lib-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090598    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-systemd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090626    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-var-lib-kubelet\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090660    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-netns\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090701    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-kubelet\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090739    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cnibin\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090797    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hck\" (UniqueName: \"kubernetes.io/projected/d167638b-6e24-4f22-b09f-0586d64d5475-kube-api-access-t9hck\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090793    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-script-lib\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090826    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090859    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c76d123-bcd8-44b8-a985-af7f30cc6c50-agent-certs\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:41.090981 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090943    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgzt\" (UniqueName: \"kubernetes.io/projected/97c26624-f81c-4ab1-97e2-2b31e7604d3c-kube-api-access-6rgzt\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.090973    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-var-lib-kubelet\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091005    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-log-socket\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091045    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-kubelet\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091115    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-modprobe-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091146    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-run\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091183    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091170    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091250    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-conf\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091224    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-k8s-cni-cncf-io\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091315    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-netd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091320    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-k8s-cni-cncf-io\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091342    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-sys\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091362    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-var-lib-kubelet\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091386    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-host\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091386    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-cni-netd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091426    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-node-log\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091435    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-netns\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.091579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091340    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-systemd\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091507    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-serviceca\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091533    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-hostroot\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091537    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-kubelet\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091575    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-sys\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091620    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-host\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091625    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-hostroot\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091667    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091568    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-daemon-config\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091717    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091723    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-modprobe-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091764    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091787    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091812    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-run\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091823    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-tmp\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091842    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-log-socket\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091935    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.091976    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cnibin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.092399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092048    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092082    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9twv\" (UniqueName: \"kubernetes.io/projected/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-kube-api-access-m9twv\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092126    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-multus-certs\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092168    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-netns\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092199    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092236    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-socket-dir-parent\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092290    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-os-release\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092316    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-daemon-config\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092325    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092377    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-host-run-multus-certs\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092450    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cnibin\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092531    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.092599    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.092725    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:41.592667931 +0000 UTC m=+3.115249970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092759    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-socket-dir-parent\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092817    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-run-netns\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092970    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysctl-d\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.093226 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.092975    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-socket-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093172    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093252    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093314    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvv26\" (UniqueName: \"kubernetes.io/projected/9c833574-e765-4413-a2c6-76583f01a26a-kube-api-access-vvv26\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093379    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-sys-fs\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093429    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-systemd-units\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093438    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-serviceca\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093466    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093501    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-host\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093521    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093552    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-system-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093568    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-systemd-units\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093579    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-etc-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093612    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-device-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093616    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-host\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093645    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l28x4\" (UniqueName: \"kubernetes.io/projected/e0790561-7d53-4555-a7cb-a92a7e7172c3-kube-api-access-l28x4\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093675    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-system-cni-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.094023 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093702    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-tuned\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093734    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-device-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093745    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-os-release\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093778    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-etc-openvswitch\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-system-cni-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093820    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093860    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-config\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093914    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-env-overrides\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093945    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093956    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.093977    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c76d123-bcd8-44b8-a985-af7f30cc6c50-konnectivity-ca\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094028    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-etc-kubernetes\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094087    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094121    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094186    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-ovn\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094226    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysconfig\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094258    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cni-binary-copy\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.094729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094289    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-conf-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094324    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c833574-e765-4413-a2c6-76583f01a26a-host-slash\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094432    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-etc-kubernetes\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094505    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d167638b-6e24-4f22-b09f-0586d64d5475-run-ovn\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094510    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c76d123-bcd8-44b8-a985-af7f30cc6c50-konnectivity-ca\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094624    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-os-release\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094829    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e0790561-7d53-4555-a7cb-a92a7e7172c3-registration-dir\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.094850    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-sysconfig\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095044    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-ovnkube-config\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095106    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-multus-conf-dir\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.095529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095497    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d167638b-6e24-4f22-b09f-0586d64d5475-env-overrides\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.096063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095813    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-cni-binary-copy\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.096063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095511    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-tmp\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.096063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.095987    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c76d123-bcd8-44b8-a985-af7f30cc6c50-agent-certs\") pod \"konnectivity-agent-8qslp\" (UID: \"8c76d123-bcd8-44b8-a985-af7f30cc6c50\") " pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:41.097169 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.096831    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:41.097169 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.096868    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:41.097169 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.096898    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:41.097169 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.096964    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:41.596947622 +0000 UTC m=+3.119529659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:41.097169 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.097108    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51ed80e2-6df4-44c4-904c-70d88d7787ea-etc-tuned\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.097405 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.097263    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d167638b-6e24-4f22-b09f-0586d64d5475-ovn-node-metrics-cert\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.099166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.099131    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmtm\" (UniqueName: \"kubernetes.io/projected/51ed80e2-6df4-44c4-904c-70d88d7787ea-kube-api-access-whmtm\") pod \"tuned-p9pmk\" (UID: \"51ed80e2-6df4-44c4-904c-70d88d7787ea\") " pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.107120 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.107074    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdv8\" (UniqueName: \"kubernetes.io/projected/c3b148e7-c1e0-4215-8370-7707e59cbba2-kube-api-access-nxdv8\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:41.107467 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.107425    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9twv\" (UniqueName: \"kubernetes.io/projected/e8bdc443-ee58-47ed-a2df-8eddd26fe32f-kube-api-access-m9twv\") pod \"node-ca-htshq\" (UID: \"e8bdc443-ee58-47ed-a2df-8eddd26fe32f\") " pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.108180 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.108162    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97bmp\" (UniqueName: \"kubernetes.io/projected/7a00d1bc-bb23-485a-bf5b-f3f4dac07285-kube-api-access-97bmp\") pod \"multus-9vnsh\" (UID: \"7a00d1bc-bb23-485a-bf5b-f3f4dac07285\") " pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.108752 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.108734    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hck\" (UniqueName: \"kubernetes.io/projected/d167638b-6e24-4f22-b09f-0586d64d5475-kube-api-access-t9hck\") pod \"ovnkube-node-qbhwc\" (UID: \"d167638b-6e24-4f22-b09f-0586d64d5475\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.109635 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.109614    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28x4\" (UniqueName: \"kubernetes.io/projected/e0790561-7d53-4555-a7cb-a92a7e7172c3-kube-api-access-l28x4\") pod \"aws-ebs-csi-driver-node-lvw4s\" (UID: \"e0790561-7d53-4555-a7cb-a92a7e7172c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.113223 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.113206    2547 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:00:41.114558 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.114514    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"5455bca543c3da4894337d6f1e9c5338","Type":"ContainerStarted","Data":"bd7281792abf0b7cae88978a53858238ec770643a7e7176fd17422c9f6a0caf3"}
May 26 16:00:41.115577 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.115556    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" event={"ID":"526f86543568486463bfd1c4f84c7011","Type":"ContainerStarted","Data":"d3562a69c70b4d7ea6f9bf1dcaec8eefbfa42a40487ef52f12589a4e0bf76e70"}
May 26 16:00:41.194766 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194725    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cnibin\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194783    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgzt\" (UniqueName: \"kubernetes.io/projected/97c26624-f81c-4ab1-97e2-2b31e7604d3c-kube-api-access-6rgzt\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194791    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cnibin\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194839    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-os-release\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194869    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194912    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvv26\" (UniqueName: \"kubernetes.io/projected/9c833574-e765-4413-a2c6-76583f01a26a-kube-api-access-vvv26\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194938    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-system-cni-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.194989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.194957    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195002    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195005    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-os-release\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195052    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c833574-e765-4413-a2c6-76583f01a26a-host-slash\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195079    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195123    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c833574-e765-4413-a2c6-76583f01a26a-iptables-alerter-script\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195162    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195168    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c833574-e765-4413-a2c6-76583f01a26a-host-slash\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.195342 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195212    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c26624-f81c-4ab1-97e2-2b31e7604d3c-system-cni-dir\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195680 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195514    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195680 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195670    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c833574-e765-4413-a2c6-76583f01a26a-iptables-alerter-script\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.195680 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195671    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.195780 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.195701    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97c26624-f81c-4ab1-97e2-2b31e7604d3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.205321 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.205262    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvv26\" (UniqueName: \"kubernetes.io/projected/9c833574-e765-4413-a2c6-76583f01a26a-kube-api-access-vvv26\") pod \"iptables-alerter-kb4mk\" (UID: \"9c833574-e765-4413-a2c6-76583f01a26a\") " pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.205418 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.205363    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgzt\" (UniqueName: \"kubernetes.io/projected/97c26624-f81c-4ab1-97e2-2b31e7604d3c-kube-api-access-6rgzt\") pod \"multus-additional-cni-plugins-wd95r\" (UID: \"97c26624-f81c-4ab1-97e2-2b31e7604d3c\") " pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.279466 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.279432    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:00:41.288478 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.288454    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:00:41.299272 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.299240    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s"
May 26 16:00:41.302862 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.302844    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p9pmk"
May 26 16:00:41.309119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.309102    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htshq"
May 26 16:00:41.315700 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.315677    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vnsh"
May 26 16:00:41.324233 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.324217    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb4mk"
May 26 16:00:41.328684 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.328668    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wd95r"
May 26 16:00:41.597973 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.597884    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:41.597973 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:41.597965    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598064    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598075    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598087    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598098    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598138    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:42.598118687 +0000 UTC m=+4.120700733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:41.598197 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:41.598153    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:42.598146616 +0000 UTC m=+4.120728643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:41.775830 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:41.775720    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bdc443_ee58_47ed_a2df_8eddd26fe32f.slice/crio-51c118be58520e2e8d3a08fbee143aebc4b38b53e69e48f37b4f932d5c086cdf WatchSource:0}: Error finding container 51c118be58520e2e8d3a08fbee143aebc4b38b53e69e48f37b4f932d5c086cdf: Status 404 returned error can't find the container with id 51c118be58520e2e8d3a08fbee143aebc4b38b53e69e48f37b4f932d5c086cdf
May 26 16:00:41.776687 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:41.776660    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c26624_f81c_4ab1_97e2_2b31e7604d3c.slice/crio-4ee064855d81866447386385ade9304bda110d331bc6553cd1bf58d4dd234692 WatchSource:0}: Error finding container 4ee064855d81866447386385ade9304bda110d331bc6553cd1bf58d4dd234692: Status 404 returned error can't find the container with id 4ee064855d81866447386385ade9304bda110d331bc6553cd1bf58d4dd234692
May 26 16:00:41.779936 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:41.779914    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a00d1bc_bb23_485a_bf5b_f3f4dac07285.slice/crio-832c865af3329fbea62207a2b2ffd1e89fd902511e72e4f9050757b143b3b87d WatchSource:0}: Error finding container 832c865af3329fbea62207a2b2ffd1e89fd902511e72e4f9050757b143b3b87d: Status 404 returned error can't find the container with id 832c865af3329fbea62207a2b2ffd1e89fd902511e72e4f9050757b143b3b87d
May 26 16:00:41.780820 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:41.780800    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c76d123_bcd8_44b8_a985_af7f30cc6c50.slice/crio-5494636cdbbcf82112778f919c606bd0cb31fc6f24c5b82b4aa77eee6765eb74 WatchSource:0}: Error finding container 5494636cdbbcf82112778f919c606bd0cb31fc6f24c5b82b4aa77eee6765eb74: Status 404 returned error can't find the container with id 5494636cdbbcf82112778f919c606bd0cb31fc6f24c5b82b4aa77eee6765eb74
May 26 16:00:42.028757 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.028724    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:55:40 +0000 UTC" deadline="2028-02-25 02:21:38.62147157 +0000 UTC"
May 26 16:00:42.028757 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.028752    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15346h20m56.592721929s"
May 26 16:00:42.110716 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.110618    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:42.110842 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.110618    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:42.110842 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.110755    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:42.110842 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.110826    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:42.117949 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.117922    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9pmk" event={"ID":"51ed80e2-6df4-44c4-904c-70d88d7787ea","Type":"ContainerStarted","Data":"5bac019266fdf689c82112bbd7b9963a69c3fee7e95b7a98b18782db011ebcf7"}
May 26 16:00:42.119285 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.119190    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s" event={"ID":"e0790561-7d53-4555-a7cb-a92a7e7172c3","Type":"ContainerStarted","Data":"c0edfc04c30235583a90890f65445628951fda66e4597d0dcead072c233bc150"}
May 26 16:00:42.120406 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.120357    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vnsh" event={"ID":"7a00d1bc-bb23-485a-bf5b-f3f4dac07285","Type":"ContainerStarted","Data":"832c865af3329fbea62207a2b2ffd1e89fd902511e72e4f9050757b143b3b87d"}
May 26 16:00:42.121694 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.121672    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htshq" event={"ID":"e8bdc443-ee58-47ed-a2df-8eddd26fe32f","Type":"ContainerStarted","Data":"51c118be58520e2e8d3a08fbee143aebc4b38b53e69e48f37b4f932d5c086cdf"}
May 26 16:00:42.123792 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.123768    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" event={"ID":"526f86543568486463bfd1c4f84c7011","Type":"ContainerStarted","Data":"9427913440e9162f646d9d914afb4bf00e3abe17124485ec6eb3d5d8687f3303"}
May 26 16:00:42.126051 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.126026    2547 generic.go:358] "Generic (PLEG): container finished" podID="5455bca543c3da4894337d6f1e9c5338" containerID="e409d776c1a46d24fb08aeab7445ea3b2f4df2a7a96514b53c3ea6fc05964b63" exitCode=0
May 26 16:00:42.126129 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.126096    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"5455bca543c3da4894337d6f1e9c5338","Type":"ContainerDied","Data":"e409d776c1a46d24fb08aeab7445ea3b2f4df2a7a96514b53c3ea6fc05964b63"}
May 26 16:00:42.128897 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.128847    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb4mk" event={"ID":"9c833574-e765-4413-a2c6-76583f01a26a","Type":"ContainerStarted","Data":"3636eabed09ab5227287c5054054a47a8a0adb2953ca23099e29a3c6d215e810"}
May 26 16:00:42.130210 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.130186    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qslp" event={"ID":"8c76d123-bcd8-44b8-a985-af7f30cc6c50","Type":"ContainerStarted","Data":"5494636cdbbcf82112778f919c606bd0cb31fc6f24c5b82b4aa77eee6765eb74"}
May 26 16:00:42.131676 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.131655    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerStarted","Data":"4ee064855d81866447386385ade9304bda110d331bc6553cd1bf58d4dd234692"}
May 26 16:00:42.133605 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.133583    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"a967ae9995eaa6c9826a0b352d96b4180f0a431072958ee7ce77c534f8d29936"}
May 26 16:00:42.145672 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.145623    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" podStartSLOduration=3.145606102 podStartE2EDuration="3.145606102s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:00:42.145016416 +0000 UTC m=+3.667598463" watchObservedRunningTime="2026-05-26 16:00:42.145606102 +0000 UTC m=+3.668188149"
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.606644    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:42.606721    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.606867    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.606900    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.606913    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.606970    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:44.606951059 +0000 UTC m=+6.129533085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.607040    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:42.607393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:42.607073    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:44.607062655 +0000 UTC m=+6.129644683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:43.164391 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:43.164349    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"5455bca543c3da4894337d6f1e9c5338","Type":"ContainerStarted","Data":"f3e56b98055ac2653a2fe6a55e20ac4b39f310d3390ab125316b724806213fe8"}
May 26 16:00:44.111922 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:44.111317    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:44.111922 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.111465    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:44.112333 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:44.111866    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:44.112333 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.112284    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:44.622145 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:44.622104    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:44.622591 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:44.622180    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:44.622591 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622345    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:44.622591 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622402    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:48.622383793 +0000 UTC m=+10.144965820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:44.622813 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622794    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:44.622899 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622819    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:44.622899 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622832    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:44.622899 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:44.622892    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:48.622861996 +0000 UTC m=+10.145444042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:46.110942 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:46.110403    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:46.110942 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:46.110539    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:46.110942 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:46.110403    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:46.111527 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:46.111066    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:48.110749 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:48.110719    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:48.111408 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.110858    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:48.111408 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:48.110719    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:48.111408 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.111011    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:48.653857    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:48.653959    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654006    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654027    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654040    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654045    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654108    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:56.654088099 +0000 UTC m=+18.176670123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:48.654156 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:48.654127    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:00:56.654117902 +0000 UTC m=+18.176699945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:50.110608 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:50.110574    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:50.111063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:50.110574    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:50.111063 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:50.110691    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:50.111063 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:50.110802    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:52.111119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:52.111083    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:52.111571 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:52.111083    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:52.111571 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:52.111225    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:52.111571 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:52.111290    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:53.336075 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.336013    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" podStartSLOduration=14.335998607 podStartE2EDuration="14.335998607s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:00:43.184729424 +0000 UTC m=+4.707311471" watchObservedRunningTime="2026-05-26 16:00:53.335998607 +0000 UTC m=+14.858580652"
May 26 16:00:53.336537 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.336515    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dmwfd"]
May 26 16:00:53.340913 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.340890    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.342982 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.342959    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tp96z\""
May 26 16:00:53.343230 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.343209    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 16:00:53.343421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.343371    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 16:00:53.386723 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.386684    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5efca32-5502-461c-9577-6b8aeb2d5c63-hosts-file\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.386723 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.386726    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5efca32-5502-461c-9577-6b8aeb2d5c63-tmp-dir\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.386946 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.386746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jrn\" (UniqueName: \"kubernetes.io/projected/b5efca32-5502-461c-9577-6b8aeb2d5c63-kube-api-access-95jrn\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.487823 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.487779    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5efca32-5502-461c-9577-6b8aeb2d5c63-tmp-dir\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.487823 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.487828    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jrn\" (UniqueName: \"kubernetes.io/projected/b5efca32-5502-461c-9577-6b8aeb2d5c63-kube-api-access-95jrn\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.488074 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.487938    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5efca32-5502-461c-9577-6b8aeb2d5c63-hosts-file\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.488074 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.488026    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b5efca32-5502-461c-9577-6b8aeb2d5c63-hosts-file\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.488296 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.488246    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5efca32-5502-461c-9577-6b8aeb2d5c63-tmp-dir\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.499393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.499368    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jrn\" (UniqueName: \"kubernetes.io/projected/b5efca32-5502-461c-9577-6b8aeb2d5c63-kube-api-access-95jrn\") pod \"node-resolver-dmwfd\" (UID: \"b5efca32-5502-461c-9577-6b8aeb2d5c63\") " pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:53.651028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:53.650949    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmwfd"
May 26 16:00:54.111126 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:54.111092    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:54.111287 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:54.111096    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:54.111287 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:54.111207    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:54.111410 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:54.111300    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:56.110751 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:56.110711    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:56.111219 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:56.110720    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:56.111219 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.110828    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:56.111219 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.110931    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:56.707822 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:56.707781    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:56.708009 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:56.707847    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:56.708009 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.707976    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:56.708009 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.707991    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:00:56.708167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.708015    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:00:56.708167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.708029    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:56.708167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.708060    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:12.708036244 +0000 UTC m=+34.230618271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:00:56.708167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:56.708080    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:12.708071709 +0000 UTC m=+34.230653732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:00:58.110597 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:58.110558    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:00:58.111069 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:58.110558    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:00:58.111069 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:58.110692    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:00:58.111069 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:00:58.110772    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:00:58.895743 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:00:58.895719    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5efca32_5502_461c_9577_6b8aeb2d5c63.slice/crio-220d13a12b37f0109e557356576cf2880b900b215d5c114790e77b5a2b386d10 WatchSource:0}: Error finding container 220d13a12b37f0109e557356576cf2880b900b215d5c114790e77b5a2b386d10: Status 404 returned error can't find the container with id 220d13a12b37f0109e557356576cf2880b900b215d5c114790e77b5a2b386d10
May 26 16:00:59.194466 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.194430    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s" event={"ID":"e0790561-7d53-4555-a7cb-a92a7e7172c3","Type":"ContainerStarted","Data":"f83384052917741284a285523caff4262bbd22cd5254a07b2712ac7f5bb5e8c6"}
May 26 16:00:59.195679 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.195656    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htshq" event={"ID":"e8bdc443-ee58-47ed-a2df-8eddd26fe32f","Type":"ContainerStarted","Data":"acbeba61ee16e5f84f081b031a1b7b7e0c1bcf28984a79dd3364e53f9df03d12"}
May 26 16:00:59.196541 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.196521    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmwfd" event={"ID":"b5efca32-5502-461c-9577-6b8aeb2d5c63","Type":"ContainerStarted","Data":"220d13a12b37f0109e557356576cf2880b900b215d5c114790e77b5a2b386d10"}
May 26 16:00:59.197591 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.197569    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qslp" event={"ID":"8c76d123-bcd8-44b8-a985-af7f30cc6c50","Type":"ContainerStarted","Data":"41f558bf2bce15a25ba949f085fe6382aa984a4b9892a1cc42a047a4d74aff3d"}
May 26 16:00:59.198808 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.198783    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerStarted","Data":"8f9db02e2273bd9f9ae00d869c15940c2afb60179025912a1bd1f6ef0d0e02d4"}
May 26 16:00:59.211427 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.211379    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-htshq" podStartSLOduration=3.099145882 podStartE2EDuration="20.211369333s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.778197624 +0000 UTC m=+3.300779654" lastFinishedPulling="2026-05-26 16:00:58.890421077 +0000 UTC m=+20.413003105" observedRunningTime="2026-05-26 16:00:59.21131353 +0000 UTC m=+20.733895574" watchObservedRunningTime="2026-05-26 16:00:59.211369333 +0000 UTC m=+20.733951395"
May 26 16:00:59.247428 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:00:59.247389    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8qslp" podStartSLOduration=3.140917906 podStartE2EDuration="20.247379241s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.783442774 +0000 UTC m=+3.306024811" lastFinishedPulling="2026-05-26 16:00:58.889904112 +0000 UTC m=+20.412486146" observedRunningTime="2026-05-26 16:00:59.247232685 +0000 UTC m=+20.769814729" watchObservedRunningTime="2026-05-26 16:00:59.247379241 +0000 UTC m=+20.769961297"
May 26 16:01:00.111316 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.111130    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:00.111488 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.111130    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:00.111488 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:00.111425    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:00.111488 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:00.111480    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:00.202386 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202362    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202600    2547 generic.go:358] "Generic (PLEG): container finished" podID="d167638b-6e24-4f22-b09f-0586d64d5475" containerID="607163088a250023c929b8f519a6800f055cbee6efe8a7e7d8edb478d9563284" exitCode=1
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202661    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"409338bc339ff3cff9405a1f38ffbc0337509653eb763a45c7273033598553fb"}
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202687    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"7f764b405a669c6f3caf5191eed4a1969830ec411a7624f3a53d7409a897669a"}
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202697    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"d2296ba46749e077141f4f1b4547b3088c211a1d2c9897efa01dc7372d78f267"}
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202705    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"333d8d3310d12a316d61043e1a5e37690360c8b3bfab74c9ede7769ec7992667"}
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202713    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerDied","Data":"607163088a250023c929b8f519a6800f055cbee6efe8a7e7d8edb478d9563284"}
May 26 16:01:00.203134 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.202722    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"7fbb0ed03b9a903f633769d2fa6f1f489662243e550dc49e33986322ecca0e4f"}
May 26 16:01:00.203811 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.203788    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p9pmk" event={"ID":"51ed80e2-6df4-44c4-904c-70d88d7787ea","Type":"ContainerStarted","Data":"bb1425f30acea4090f0ad853d9d824d74fc43a3410e1e24792dea043a2afc54f"}
May 26 16:01:00.205005 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.204985    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vnsh" event={"ID":"7a00d1bc-bb23-485a-bf5b-f3f4dac07285","Type":"ContainerStarted","Data":"105314f277c1e857a4b549b295a9d547fd915b773e197fdf493f83920f15f7e0"}
May 26 16:01:00.205987 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.205969    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmwfd" event={"ID":"b5efca32-5502-461c-9577-6b8aeb2d5c63","Type":"ContainerStarted","Data":"713f4363fa8398e0d55afce8c60bb8cec243eec36177f11514e412db81e266d0"}
May 26 16:01:00.207058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.207024    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="8f9db02e2273bd9f9ae00d869c15940c2afb60179025912a1bd1f6ef0d0e02d4" exitCode=0
May 26 16:01:00.207137 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.207082    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"8f9db02e2273bd9f9ae00d869c15940c2afb60179025912a1bd1f6ef0d0e02d4"}
May 26 16:01:00.252210 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.252157    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p9pmk" podStartSLOduration=4.148067461 podStartE2EDuration="21.252142341s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.787697936 +0000 UTC m=+3.310279958" lastFinishedPulling="2026-05-26 16:00:58.89177281 +0000 UTC m=+20.414354838" observedRunningTime="2026-05-26 16:01:00.229785276 +0000 UTC m=+21.752367321" watchObservedRunningTime="2026-05-26 16:01:00.252142341 +0000 UTC m=+21.774724386"
May 26 16:01:00.284807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.284769    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dmwfd" podStartSLOduration=7.284756625 podStartE2EDuration="7.284756625s" podCreationTimestamp="2026-05-26 16:00:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:01:00.252336001 +0000 UTC m=+21.774918045" watchObservedRunningTime="2026-05-26 16:01:00.284756625 +0000 UTC m=+21.807338669"
May 26 16:01:00.317277 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.317225    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9vnsh" podStartSLOduration=3.807503017 podStartE2EDuration="21.317210527s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.781699409 +0000 UTC m=+3.304281442" lastFinishedPulling="2026-05-26 16:00:59.291406914 +0000 UTC m=+20.813988952" observedRunningTime="2026-05-26 16:01:00.285324843 +0000 UTC m=+21.807906885" watchObservedRunningTime="2026-05-26 16:01:00.317210527 +0000 UTC m=+21.839792572"
May 26 16:01:00.527996 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:00.527974    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 16:01:01.058755 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:01.058607    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T16:01:00.527992293Z","UUID":"1ab9d739-a85e-4b2d-8301-4829340aa24e","Handler":null,"Name":"","Endpoint":""}
May 26 16:01:01.060579 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:01.060533    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 16:01:01.060733 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:01.060594    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 16:01:01.211358 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:01.211320    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s" event={"ID":"e0790561-7d53-4555-a7cb-a92a7e7172c3","Type":"ContainerStarted","Data":"4e4a01f48b5a56aed4594e795c20248d43e006368c5b570bc45939b8943ee5da"}
May 26 16:01:01.212922 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:01.212893    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb4mk" event={"ID":"9c833574-e765-4413-a2c6-76583f01a26a","Type":"ContainerStarted","Data":"26002f9ff9ecbd44852976ace3edb77a371385c0ee53d0316d2de107a1d7c6c0"}
May 26 16:01:02.032539 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.032386    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:01:02.032982 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.032959    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:01:02.060219 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.060138    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kb4mk" podStartSLOduration=5.958052862 podStartE2EDuration="23.060123883s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.788286798 +0000 UTC m=+3.310868826" lastFinishedPulling="2026-05-26 16:00:58.890357821 +0000 UTC m=+20.412939847" observedRunningTime="2026-05-26 16:01:01.238428628 +0000 UTC m=+22.761010673" watchObservedRunningTime="2026-05-26 16:01:02.060123883 +0000 UTC m=+23.582705945"
May 26 16:01:02.111264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.111236    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:02.111399 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.111236    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:02.111399 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:02.111338    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:02.111468 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:02.111410    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:02.216972 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.216938    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s" event={"ID":"e0790561-7d53-4555-a7cb-a92a7e7172c3","Type":"ContainerStarted","Data":"9e7a1f26eb229abd8f9b59f4e7f49503dc2635e7e67b777384859cdd3eddbe82"}
May 26 16:01:02.219484 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.219459    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:01:02.219740 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.219722    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"c73f80df35b7e21c42a03aefc7d9a6725f81ef1f04e2193e2e45551f0986e69e"}
May 26 16:01:02.220020 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.220005    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:01:02.220393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.220379    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8qslp"
May 26 16:01:02.293646 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:02.293588    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvw4s" podStartSLOduration=3.276709507 podStartE2EDuration="23.293569586s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.787785797 +0000 UTC m=+3.310367819" lastFinishedPulling="2026-05-26 16:01:01.804645872 +0000 UTC m=+23.327227898" observedRunningTime="2026-05-26 16:01:02.259321533 +0000 UTC m=+23.781903578" watchObservedRunningTime="2026-05-26 16:01:02.293569586 +0000 UTC m=+23.816151633"
May 26 16:01:04.111246 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:04.111210    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:04.111930 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:04.111210    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:04.111930 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:04.111400    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:04.111930 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:04.111484    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:05.226417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.226238    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="198344e7d37f7490d1ca79aabb55f64851eb167585eeed0847989df94997e7ab" exitCode=0
May 26 16:01:05.227003 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.226317    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"198344e7d37f7490d1ca79aabb55f64851eb167585eeed0847989df94997e7ab"}
May 26 16:01:05.229325 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.229310    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:01:05.229631 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.229601    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"de9e4548b9fc0b1d4eebcfe80060ad602ee0ea77be189941e2182e7055fd4ffd"}
May 26 16:01:05.229831 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.229816    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:05.230036 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.229891    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:05.230093 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.230069    2547 scope.go:117] "RemoveContainer" containerID="607163088a250023c929b8f519a6800f055cbee6efe8a7e7d8edb478d9563284"
May 26 16:01:05.245770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:05.245748    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:06.110996 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.110968    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:06.111166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.110969    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:06.111166 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:06.111107    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:06.111166 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:06.111136    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:06.233265 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.233177    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="2379c057767afac24d1a2248e25509d45cde10c6baceb033f862cdd4e3b395fb" exitCode=0
May 26 16:01:06.233683 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.233269    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"2379c057767afac24d1a2248e25509d45cde10c6baceb033f862cdd4e3b395fb"}
May 26 16:01:06.236557 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.236538    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:01:06.236862 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.236835    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" event={"ID":"d167638b-6e24-4f22-b09f-0586d64d5475","Type":"ContainerStarted","Data":"5b6e36672e922a2aef1700f04eff490202ba1a6f6e5f8deacc8278ab3c02b3bc"}
May 26 16:01:06.237159 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.237142    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:06.252572 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.252548    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:06.293189 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:06.293148    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc" podStartSLOduration=10.144210042 podStartE2EDuration="27.293135624s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.7886495 +0000 UTC m=+3.311231528" lastFinishedPulling="2026-05-26 16:00:58.937575077 +0000 UTC m=+20.460157110" observedRunningTime="2026-05-26 16:01:06.292398743 +0000 UTC m=+27.814980798" watchObservedRunningTime="2026-05-26 16:01:06.293135624 +0000 UTC m=+27.815717668"
May 26 16:01:07.054924 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.054716    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87r2b"]
May 26 16:01:07.055043 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.055015    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:07.055130 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:07.055108    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:07.056558 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.056538    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtfd5"]
May 26 16:01:07.056642 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.056610    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:07.056693 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:07.056675    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:07.243296 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.243261    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="6ee09ee8654b5e3cbba82e3c3abca70346a2f3846bb67989e74c35205da08deb" exitCode=0
May 26 16:01:07.243732 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:07.243298    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"6ee09ee8654b5e3cbba82e3c3abca70346a2f3846bb67989e74c35205da08deb"}
May 26 16:01:08.110645 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:08.110611    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:08.110805 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:08.110761    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:09.112676 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:09.112368    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:09.112676 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:09.112479    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:10.110679 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:10.110610    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:10.110820 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:10.110722    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87r2b" podUID="c3b148e7-c1e0-4215-8370-7707e59cbba2"
May 26 16:01:11.111235 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.111172    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:11.111702 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.111300    2547 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtfd5" podUID="d3fb12b8-361b-4f71-b77f-1d495de4a679"
May 26 16:01:11.833295 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.833257    2547 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeReady"
May 26 16:01:11.833457 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.833423    2547 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 16:01:11.897666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.897634    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:01:11.901817 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.901797    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:11.904385 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.904352    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-fjfhr\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjfhr\"" type="*v1.Secret"
May 26 16:01:11.904385 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.904352    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret"
May 26 16:01:11.904385 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.904352    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret"
May 26 16:01:11.904577 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.904406    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
May 26 16:01:11.905355 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.905321    2547 status_manager.go:895] "Failed to get status for pod" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" err="pods \"image-registry-f5f98ff48-5vv2l\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object"
May 26 16:01:11.905467 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:11.905406    2547 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap"
May 26 16:01:11.906809 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.906788    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zq4hz"]
May 26 16:01:11.909514 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.909494    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:11.912266 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.912246    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5dnjd"]
May 26 16:01:11.915262 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.915243    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:11.923493 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.923428    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:01:11.927983 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.927961    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 16:01:11.928125 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.927968    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 16:01:11.931642 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.931527    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zq4hz"]
May 26 16:01:11.931785 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.931665    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghgvl\""
May 26 16:01:11.935326 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.935266    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 16:01:11.935522 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.935500    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 16:01:11.936305 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.936285    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5dnjd"]
May 26 16:01:11.938465 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.938444    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6bgll\""
May 26 16:01:11.938979 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:11.938962    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 16:01:12.019921 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.019865    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqbf\" (UniqueName: \"kubernetes.io/projected/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-kube-api-access-2gqbf\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.019921 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.019924    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.019953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gpq\" (UniqueName: \"kubernetes.io/projected/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-kube-api-access-z8gpq\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.019985    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020069    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020158    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020231    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-tmp-dir\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.020582 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020270    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020582 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020303    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020582 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020323    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6kh\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020582 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.020582 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.020427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-config-volume\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.111068 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.111032    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:12.114742 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.114710    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 16:01:12.115708 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.115691    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8kf8\""
May 26 16:01:12.121094 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121073    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqbf\" (UniqueName: \"kubernetes.io/projected/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-kube-api-access-2gqbf\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.121215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121102    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.121215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121126    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gpq\" (UniqueName: \"kubernetes.io/projected/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-kube-api-access-z8gpq\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.121215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121156    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121191    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121214    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121247    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121278    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121319    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-tmp-dir\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121348    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121371    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121395    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6kh\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121649 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121433    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.121649 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121465    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-config-volume\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.121649 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.121248    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:01:12.121649 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.121636    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls podName:e5a79bf9-89c4-43ed-ac2e-440b69c78a55 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:12.621616933 +0000 UTC m=+34.144198956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls") pod "dns-default-5dnjd" (UID: "e5a79bf9-89c4-43ed-ac2e-440b69c78a55") : secret "dns-default-metrics-tls" not found
May 26 16:01:12.121649 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.121647    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:01:12.121911 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.121700    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert podName:1d6f4d6d-9768-4aab-af64-9afc90e04eb5 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:12.621683131 +0000 UTC m=+34.144265166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert") pod "ingress-canary-zq4hz" (UID: "1d6f4d6d-9768-4aab-af64-9afc90e04eb5") : secret "canary-serving-cert" not found
May 26 16:01:12.121911 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.121805    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.122074 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.122052    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-tmp-dir\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.122140 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.122071    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-config-volume\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.122246 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.122221    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.136472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.136449    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqbf\" (UniqueName: \"kubernetes.io/projected/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-kube-api-access-2gqbf\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.142777 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.142755    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.144507 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.144484    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6kh\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.158260 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.158237    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gpq\" (UniqueName: \"kubernetes.io/projected/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-kube-api-access-z8gpq\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.625960 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.625912    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:12.626157 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.626021    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:12.626157 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.626084    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:01:12.626157 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.626119    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:01:12.626283 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.626164    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert podName:1d6f4d6d-9768-4aab-af64-9afc90e04eb5 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:13.626144019 +0000 UTC m=+35.148726043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert") pod "ingress-canary-zq4hz" (UID: "1d6f4d6d-9768-4aab-af64-9afc90e04eb5") : secret "canary-serving-cert" not found
May 26 16:01:12.626283 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.626186    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls podName:e5a79bf9-89c4-43ed-ac2e-440b69c78a55 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:13.626176097 +0000 UTC m=+35.148758126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls") pod "dns-default-5dnjd" (UID: "e5a79bf9-89c4-43ed-ac2e-440b69c78a55") : secret "dns-default-metrics-tls" not found
May 26 16:01:12.708589 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.708545    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 16:01:12.715176 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.715148    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:12.726980 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.726946    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:12.727140 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.727117    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:12.727140 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727136    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:01:12.727309 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727160    2547 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:01:12.727309 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727174    2547 projected.go:194] Error preparing data for projected volume kube-api-access-5zk6h for pod openshift-network-diagnostics/network-check-target-jtfd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:12.727309 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727259    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h podName:d3fb12b8-361b-4f71-b77f-1d495de4a679 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:44.727238919 +0000 UTC m=+66.249820964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk6h" (UniqueName: "kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h") pod "network-check-target-jtfd5" (UID: "d3fb12b8-361b-4f71-b77f-1d495de4a679") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:01:12.727309 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727291    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 16:01:12.727522 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:12.727345    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs podName:c3b148e7-c1e0-4215-8370-7707e59cbba2 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:44.727329279 +0000 UTC m=+66.249911306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs") pod "network-metrics-daemon-87r2b" (UID: "c3b148e7-c1e0-4215-8370-7707e59cbba2") : secret "metrics-daemon-secret" not found
May 26 16:01:12.806213 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.806172    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 16:01:12.807027 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.807005    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjfhr\""
May 26 16:01:12.814862 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:12.814835    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:13.110770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.110731    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:13.113662 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.113621    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:01:13.113811 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.113621    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8h4d8\""
May 26 16:01:13.113811 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.113625    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:01:13.121795 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.121764    2547 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition
May 26 16:01:13.122226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.121841    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: failed to sync secret cache: timed out waiting for the condition
May 26 16:01:13.122226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.121851    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:13.621828455 +0000 UTC m=+35.144410485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : failed to sync configmap cache: timed out waiting for the condition
May 26 16:01:13.122226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.121858    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5f98ff48-5vv2l: failed to sync secret cache: timed out waiting for the condition
May 26 16:01:13.122226 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.121921    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:13.621908651 +0000 UTC m=+35.144490679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : failed to sync secret cache: timed out waiting for the condition
May 26 16:01:13.123263 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.123241    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 16:01:13.180819 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.180779    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 16:01:13.634914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.634866    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:13.635080 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.634925    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:13.635080 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635033    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:01:13.635187 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635094    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls podName:e5a79bf9-89c4-43ed-ac2e-440b69c78a55 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:15.63507679 +0000 UTC m=+37.157658812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls") pod "dns-default-5dnjd" (UID: "e5a79bf9-89c4-43ed-ac2e-440b69c78a55") : secret "dns-default-metrics-tls" not found
May 26 16:01:13.635187 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.635114    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:13.635187 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.635157    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:13.635349 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635223    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:01:13.635349 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635231    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5f98ff48-5vv2l: secret "image-registry-tls" not found
May 26 16:01:13.635349 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635234    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:01:13.635349 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635252    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:14.635245636 +0000 UTC m=+36.157827659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : secret "image-registry-tls" not found
May 26 16:01:13.635349 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:13.635290    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert podName:1d6f4d6d-9768-4aab-af64-9afc90e04eb5 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:15.635277307 +0000 UTC m=+37.157859329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert") pod "ingress-canary-zq4hz" (UID: "1d6f4d6d-9768-4aab-af64-9afc90e04eb5") : secret "canary-serving-cert" not found
May 26 16:01:13.636061 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:13.636038    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:14.261069 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:14.261033    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="19efe64be3d2cbd155d71cab2ce4ebb3240a3d0c6128ced4c91ce5c145505a1c" exitCode=0
May 26 16:01:14.261430 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:14.261092    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"19efe64be3d2cbd155d71cab2ce4ebb3240a3d0c6128ced4c91ce5c145505a1c"}
May 26 16:01:14.643299 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:14.643219    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:14.643429 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:14.643332    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:01:14.643429 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:14.643343    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5f98ff48-5vv2l: secret "image-registry-tls" not found
May 26 16:01:14.643429 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:14.643403    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:16.643387346 +0000 UTC m=+38.165969368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : secret "image-registry-tls" not found
May 26 16:01:14.812187 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:14.812160    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmwfd_b5efca32-5502-461c-9577-6b8aeb2d5c63/dns-node-resolver/0.log"
May 26 16:01:15.265588 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:15.265383    2547 generic.go:358] "Generic (PLEG): container finished" podID="97c26624-f81c-4ab1-97e2-2b31e7604d3c" containerID="19b1ec7a192ffe813ec358f6109c4c75e89f99c8bfc55a492ac031a21b09cd0c" exitCode=0
May 26 16:01:15.265588 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:15.265464    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerDied","Data":"19b1ec7a192ffe813ec358f6109c4c75e89f99c8bfc55a492ac031a21b09cd0c"}
May 26 16:01:15.651251 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:15.651132    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:15.651251 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:15.651175    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:15.651440 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:15.651280    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:01:15.651440 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:15.651283    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:01:15.651440 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:15.651334    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert podName:1d6f4d6d-9768-4aab-af64-9afc90e04eb5 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:19.651318062 +0000 UTC m=+41.173900102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert") pod "ingress-canary-zq4hz" (UID: "1d6f4d6d-9768-4aab-af64-9afc90e04eb5") : secret "canary-serving-cert" not found
May 26 16:01:15.651440 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:15.651347    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls podName:e5a79bf9-89c4-43ed-ac2e-440b69c78a55 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:19.65134151 +0000 UTC m=+41.173923533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls") pod "dns-default-5dnjd" (UID: "e5a79bf9-89c4-43ed-ac2e-440b69c78a55") : secret "dns-default-metrics-tls" not found
May 26 16:01:16.012140 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:16.012110    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htshq_e8bdc443-ee58-47ed-a2df-8eddd26fe32f/node-ca/0.log"
May 26 16:01:16.269721 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:16.269638    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd95r" event={"ID":"97c26624-f81c-4ab1-97e2-2b31e7604d3c","Type":"ContainerStarted","Data":"997c2cf2abfa59e48259d7a91c04f3111b9a1b30a69a82a2070cb0e22f0b01bf"}
May 26 16:01:16.296105 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:16.296059    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wd95r" podStartSLOduration=5.193390517 podStartE2EDuration="37.29604598s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:00:41.778631272 +0000 UTC m=+3.301213301" lastFinishedPulling="2026-05-26 16:01:13.881286738 +0000 UTC m=+35.403868764" observedRunningTime="2026-05-26 16:01:16.295434517 +0000 UTC m=+37.818016563" watchObservedRunningTime="2026-05-26 16:01:16.29604598 +0000 UTC m=+37.818628024"
May 26 16:01:16.659415 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:16.659330    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:16.659591 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:16.659496    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:01:16.659591 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:16.659517    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5f98ff48-5vv2l: secret "image-registry-tls" not found
May 26 16:01:16.659591 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:16.659587    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:20.659567474 +0000 UTC m=+42.182149499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : secret "image-registry-tls" not found
May 26 16:01:19.682275 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:19.682232    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:19.682635 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:19.682379    2547 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:01:19.682635 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:19.682428    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:19.682635 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:19.682443    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert podName:1d6f4d6d-9768-4aab-af64-9afc90e04eb5 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:27.68242626 +0000 UTC m=+49.205008282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert") pod "ingress-canary-zq4hz" (UID: "1d6f4d6d-9768-4aab-af64-9afc90e04eb5") : secret "canary-serving-cert" not found
May 26 16:01:19.682635 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:19.682505    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:01:19.682635 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:19.682551    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls podName:e5a79bf9-89c4-43ed-ac2e-440b69c78a55 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:27.682538205 +0000 UTC m=+49.205120228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls") pod "dns-default-5dnjd" (UID: "e5a79bf9-89c4-43ed-ac2e-440b69c78a55") : secret "dns-default-metrics-tls" not found
May 26 16:01:20.688558 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:20.688519    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:20.688967 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:20.688635    2547 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:01:20.688967 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:20.688647    2547 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5f98ff48-5vv2l: secret "image-registry-tls" not found
May 26 16:01:20.688967 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:20.688702    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls podName:eb00bfbe-3d25-4308-9d15-a1ebf6673389 nodeName:}" failed. No retries permitted until 2026-05-26 16:01:28.688684789 +0000 UTC m=+50.211267039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls") pod "image-registry-f5f98ff48-5vv2l" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389") : secret "image-registry-tls" not found
May 26 16:01:27.744115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.744073    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:27.744667 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.744127    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:27.747201 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.747180    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d6f4d6d-9768-4aab-af64-9afc90e04eb5-cert\") pod \"ingress-canary-zq4hz\" (UID: \"1d6f4d6d-9768-4aab-af64-9afc90e04eb5\") " pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:27.747334 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.747195    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5a79bf9-89c4-43ed-ac2e-440b69c78a55-metrics-tls\") pod \"dns-default-5dnjd\" (UID: \"e5a79bf9-89c4-43ed-ac2e-440b69c78a55\") " pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:27.822272 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.822243    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zq4hz"
May 26 16:01:27.828006 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.827982    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:27.987985 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.987959    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5dnjd"]
May 26 16:01:27.991609 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:27.991583    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a79bf9_89c4_43ed_ac2e_440b69c78a55.slice/crio-56c01ca07612d7bf8c60e442df5bff4f91d107f7ba10e88f3b500cbae6930fca WatchSource:0}: Error finding container 56c01ca07612d7bf8c60e442df5bff4f91d107f7ba10e88f3b500cbae6930fca: Status 404 returned error can't find the container with id 56c01ca07612d7bf8c60e442df5bff4f91d107f7ba10e88f3b500cbae6930fca
May 26 16:01:27.994507 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:27.994450    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zq4hz"]
May 26 16:01:27.998677 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:27.998656    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6f4d6d_9768_4aab_af64_9afc90e04eb5.slice/crio-d99e42e03e8a4b66d2ff717742b106bbaf75ffe9eb75c457385fa26c74388b24 WatchSource:0}: Error finding container d99e42e03e8a4b66d2ff717742b106bbaf75ffe9eb75c457385fa26c74388b24: Status 404 returned error can't find the container with id d99e42e03e8a4b66d2ff717742b106bbaf75ffe9eb75c457385fa26c74388b24
May 26 16:01:28.292777 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:28.292686    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dnjd" event={"ID":"e5a79bf9-89c4-43ed-ac2e-440b69c78a55","Type":"ContainerStarted","Data":"56c01ca07612d7bf8c60e442df5bff4f91d107f7ba10e88f3b500cbae6930fca"}
May 26 16:01:28.293650 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:28.293626    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zq4hz" event={"ID":"1d6f4d6d-9768-4aab-af64-9afc90e04eb5","Type":"ContainerStarted","Data":"d99e42e03e8a4b66d2ff717742b106bbaf75ffe9eb75c457385fa26c74388b24"}
May 26 16:01:28.752508 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:28.752083    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:28.755170 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:28.755123    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"image-registry-f5f98ff48-5vv2l\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") " pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:29.013144 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.013050    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:29.160493 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.160465    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:01:29.164192 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:29.164165    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb00bfbe_3d25_4308_9d15_a1ebf6673389.slice/crio-2f40e0739fb064c0516d2cf0d4f36e9e5f8c43afc9a70cd526f96b8eeffa4977 WatchSource:0}: Error finding container 2f40e0739fb064c0516d2cf0d4f36e9e5f8c43afc9a70cd526f96b8eeffa4977: Status 404 returned error can't find the container with id 2f40e0739fb064c0516d2cf0d4f36e9e5f8c43afc9a70cd526f96b8eeffa4977
May 26 16:01:29.297155 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.297075    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" event={"ID":"eb00bfbe-3d25-4308-9d15-a1ebf6673389","Type":"ContainerStarted","Data":"79eaa21c4758597806de0ea928ca5a0c9c5612a3a2406ef28e1558fdf0643f94"}
May 26 16:01:29.297155 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.297117    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" event={"ID":"eb00bfbe-3d25-4308-9d15-a1ebf6673389","Type":"ContainerStarted","Data":"2f40e0739fb064c0516d2cf0d4f36e9e5f8c43afc9a70cd526f96b8eeffa4977"}
May 26 16:01:29.297341 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.297217    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:29.318466 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:29.318390    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" podStartSLOduration=52.318372401 podStartE2EDuration="52.318372401s" podCreationTimestamp="2026-05-26 16:00:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:01:29.317268871 +0000 UTC m=+50.839850918" watchObservedRunningTime="2026-05-26 16:01:29.318372401 +0000 UTC m=+50.840954445"
May 26 16:01:31.302774 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.302727    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zq4hz" event={"ID":"1d6f4d6d-9768-4aab-af64-9afc90e04eb5","Type":"ContainerStarted","Data":"daa6e364f473be15ed75577479207ef29c3cca09af48c5bcad8da21676805f0f"}
May 26 16:01:31.304184 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.304160    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dnjd" event={"ID":"e5a79bf9-89c4-43ed-ac2e-440b69c78a55","Type":"ContainerStarted","Data":"8f6fbf4d7dc69b74506f1d9f4630742de76c4d5ccb14db32c3c90b75b9e0ba7c"}
May 26 16:01:31.304291 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.304191    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dnjd" event={"ID":"e5a79bf9-89c4-43ed-ac2e-440b69c78a55","Type":"ContainerStarted","Data":"2e2403efb954442ca25f7e35a9100e8aa341e5d6a14b04fb5fa772ba2aaa3319"}
May 26 16:01:31.304348 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.304292    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:31.333081 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.333034    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zq4hz" podStartSLOduration=17.769896063 podStartE2EDuration="20.333022237s" podCreationTimestamp="2026-05-26 16:01:11 +0000 UTC" firstStartedPulling="2026-05-26 16:01:28.000245435 +0000 UTC m=+49.522827478" lastFinishedPulling="2026-05-26 16:01:30.563371615 +0000 UTC m=+52.085953652" observedRunningTime="2026-05-26 16:01:31.331340774 +0000 UTC m=+52.853922829" watchObservedRunningTime="2026-05-26 16:01:31.333022237 +0000 UTC m=+52.855604282"
May 26 16:01:31.362931 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:31.362890    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5dnjd" podStartSLOduration=17.797138671 podStartE2EDuration="20.362856948s" podCreationTimestamp="2026-05-26 16:01:11 +0000 UTC" firstStartedPulling="2026-05-26 16:01:27.992933034 +0000 UTC m=+49.515515057" lastFinishedPulling="2026-05-26 16:01:30.558651308 +0000 UTC m=+52.081233334" observedRunningTime="2026-05-26 16:01:31.362063947 +0000 UTC m=+52.884645992" watchObservedRunningTime="2026-05-26 16:01:31.362856948 +0000 UTC m=+52.885439002"
May 26 16:01:36.508694 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.508659    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:01:36.517309 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.517282    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kv5v2"]
May 26 16:01:36.554792 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.554771    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kv5v2"]
May 26 16:01:36.554907 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.554895    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.559048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.559025    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 16:01:36.559161 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.559025    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 16:01:36.559161 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.559034    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ltrjt\""
May 26 16:01:36.559351 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.559332    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 16:01:36.559429 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.559411    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 16:01:36.596605 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.596581    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-wvfpf"]
May 26 16:01:36.618950 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.618930    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-wvfpf"]
May 26 16:01:36.619078 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.619023    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:36.621506 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.621491    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 16:01:36.621709 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.621684    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kv6cq\""
May 26 16:01:36.621867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.621852    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 16:01:36.710378 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.710345    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89110749-1546-4744-86e5-155487643e8d-crio-socket\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.710378 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.710384    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwx55\" (UniqueName: \"kubernetes.io/projected/89110749-1546-4744-86e5-155487643e8d-kube-api-access-hwx55\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.710600 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.710407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89110749-1546-4744-86e5-155487643e8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.710600 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.710453    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89110749-1546-4744-86e5-155487643e8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.710600 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.710489    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89110749-1546-4744-86e5-155487643e8d-data-volume\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.811761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811677    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89110749-1546-4744-86e5-155487643e8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.811761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811718    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89110749-1546-4744-86e5-155487643e8d-data-volume\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6c5j\" (UniqueName: \"kubernetes.io/projected/a357b4a5-225d-4366-92f3-6a017caa1257-kube-api-access-x6c5j\") pod \"downloads-57bd96b888-wvfpf\" (UID: \"a357b4a5-225d-4366-92f3-6a017caa1257\") " pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:36.812007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811798    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89110749-1546-4744-86e5-155487643e8d-crio-socket\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811865    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89110749-1546-4744-86e5-155487643e8d-crio-socket\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811898    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwx55\" (UniqueName: \"kubernetes.io/projected/89110749-1546-4744-86e5-155487643e8d-kube-api-access-hwx55\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.811940    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89110749-1546-4744-86e5-155487643e8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812240 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.812172    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89110749-1546-4744-86e5-155487643e8d-data-volume\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.812349 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.812334    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89110749-1546-4744-86e5-155487643e8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.814105 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.814087    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89110749-1546-4744-86e5-155487643e8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.823366 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.823339    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwx55\" (UniqueName: \"kubernetes.io/projected/89110749-1546-4744-86e5-155487643e8d-kube-api-access-hwx55\") pod \"insights-runtime-extractor-kv5v2\" (UID: \"89110749-1546-4744-86e5-155487643e8d\") " pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.863904 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.863868    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kv5v2"
May 26 16:01:36.913442 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.913407    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6c5j\" (UniqueName: \"kubernetes.io/projected/a357b4a5-225d-4366-92f3-6a017caa1257-kube-api-access-x6c5j\") pod \"downloads-57bd96b888-wvfpf\" (UID: \"a357b4a5-225d-4366-92f3-6a017caa1257\") " pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:36.923529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.923490    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6c5j\" (UniqueName: \"kubernetes.io/projected/a357b4a5-225d-4366-92f3-6a017caa1257-kube-api-access-x6c5j\") pod \"downloads-57bd96b888-wvfpf\" (UID: \"a357b4a5-225d-4366-92f3-6a017caa1257\") " pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:36.929150 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.929129    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:36.991526 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:36.991398    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kv5v2"]
May 26 16:01:36.995817 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:36.995789    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89110749_1546_4744_86e5_155487643e8d.slice/crio-47eb49ab1da2addefd68193999b4638941e1ee5e3b6d11fd7761431e729f4bb7 WatchSource:0}: Error finding container 47eb49ab1da2addefd68193999b4638941e1ee5e3b6d11fd7761431e729f4bb7: Status 404 returned error can't find the container with id 47eb49ab1da2addefd68193999b4638941e1ee5e3b6d11fd7761431e729f4bb7
May 26 16:01:37.056744 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:37.056719    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-wvfpf"]
May 26 16:01:37.061371 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:37.061347    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda357b4a5_225d_4366_92f3_6a017caa1257.slice/crio-f34665dc0c963acbc9927ce08dd3f3a74d9be0859601f3b0fbf41cc634f46a36 WatchSource:0}: Error finding container f34665dc0c963acbc9927ce08dd3f3a74d9be0859601f3b0fbf41cc634f46a36: Status 404 returned error can't find the container with id f34665dc0c963acbc9927ce08dd3f3a74d9be0859601f3b0fbf41cc634f46a36
May 26 16:01:37.317721 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:37.317630    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-wvfpf" event={"ID":"a357b4a5-225d-4366-92f3-6a017caa1257","Type":"ContainerStarted","Data":"f34665dc0c963acbc9927ce08dd3f3a74d9be0859601f3b0fbf41cc634f46a36"}
May 26 16:01:37.318791 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:37.318772    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv5v2" event={"ID":"89110749-1546-4744-86e5-155487643e8d","Type":"ContainerStarted","Data":"0588d49b270d739081a67b176cf89aff9f8bdd384bef8bab095c273a83524f8e"}
May 26 16:01:37.318894 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:37.318795    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv5v2" event={"ID":"89110749-1546-4744-86e5-155487643e8d","Type":"ContainerStarted","Data":"47eb49ab1da2addefd68193999b4638941e1ee5e3b6d11fd7761431e729f4bb7"}
May 26 16:01:38.259473 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:38.259447    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbhwc"
May 26 16:01:38.324679 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:38.324631    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv5v2" event={"ID":"89110749-1546-4744-86e5-155487643e8d","Type":"ContainerStarted","Data":"96efde4ee3c2f7a02f3c4c131e5ee10bfc5c1f1e22c325f57b87f3728907c3ed"}
May 26 16:01:40.331705 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:40.331669    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv5v2" event={"ID":"89110749-1546-4744-86e5-155487643e8d","Type":"ContainerStarted","Data":"2b444298f7e5f8b63fc6344fe299fccff3188cb1367808147ba5d4baec9b9b26"}
May 26 16:01:41.308634 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:41.308604    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5dnjd"
May 26 16:01:41.354368 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:41.354308    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kv5v2" podStartSLOduration=3.197433028 podStartE2EDuration="5.354291766s" podCreationTimestamp="2026-05-26 16:01:36 +0000 UTC" firstStartedPulling="2026-05-26 16:01:37.123378285 +0000 UTC m=+58.645960312" lastFinishedPulling="2026-05-26 16:01:39.280237013 +0000 UTC m=+60.802819050" observedRunningTime="2026-05-26 16:01:40.361422874 +0000 UTC m=+61.884004914" watchObservedRunningTime="2026-05-26 16:01:41.354291766 +0000 UTC m=+62.876873840"
May 26 16:01:44.773393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.773359    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:44.773768 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.773415    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:44.775707 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.775679    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3b148e7-c1e0-4215-8370-7707e59cbba2-metrics-certs\") pod \"network-metrics-daemon-87r2b\" (UID: \"c3b148e7-c1e0-4215-8370-7707e59cbba2\") " pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:44.775819 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.775737    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:01:44.785800 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.785777    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:01:44.796478 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.796461    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk6h\" (UniqueName: \"kubernetes.io/projected/d3fb12b8-361b-4f71-b77f-1d495de4a679-kube-api-access-5zk6h\") pod \"network-check-target-jtfd5\" (UID: \"d3fb12b8-361b-4f71-b77f-1d495de4a679\") " pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:44.822287 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.822265    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8kf8\""
May 26 16:01:44.831082 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.831063    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87r2b"
May 26 16:01:44.925062 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.925032    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8h4d8\""
May 26 16:01:44.933166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.933139    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:44.964963 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:44.964933    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87r2b"]
May 26 16:01:44.968267 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:44.968237    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b148e7_c1e0_4215_8370_7707e59cbba2.slice/crio-a2300df6bf9dfb76a2534ceb75ec40b4536211ac1ec76745f9041c70c1ae419f WatchSource:0}: Error finding container a2300df6bf9dfb76a2534ceb75ec40b4536211ac1ec76745f9041c70c1ae419f: Status 404 returned error can't find the container with id a2300df6bf9dfb76a2534ceb75ec40b4536211ac1ec76745f9041c70c1ae419f
May 26 16:01:45.087036 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:45.086969    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtfd5"]
May 26 16:01:45.089698 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:45.089671    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fb12b8_361b_4f71_b77f_1d495de4a679.slice/crio-57c629a28bdda6c4be43ed93fcde369ab92c499db9e45b2ba66fcb06abbb8ec6 WatchSource:0}: Error finding container 57c629a28bdda6c4be43ed93fcde369ab92c499db9e45b2ba66fcb06abbb8ec6: Status 404 returned error can't find the container with id 57c629a28bdda6c4be43ed93fcde369ab92c499db9e45b2ba66fcb06abbb8ec6
May 26 16:01:45.346184 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:45.346095    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87r2b" event={"ID":"c3b148e7-c1e0-4215-8370-7707e59cbba2","Type":"ContainerStarted","Data":"a2300df6bf9dfb76a2534ceb75ec40b4536211ac1ec76745f9041c70c1ae419f"}
May 26 16:01:45.347167 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:45.347133    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtfd5" event={"ID":"d3fb12b8-361b-4f71-b77f-1d495de4a679","Type":"ContainerStarted","Data":"57c629a28bdda6c4be43ed93fcde369ab92c499db9e45b2ba66fcb06abbb8ec6"}
May 26 16:01:46.352061 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:46.352030    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87r2b" event={"ID":"c3b148e7-c1e0-4215-8370-7707e59cbba2","Type":"ContainerStarted","Data":"c436c15decc87c96ca188b97e383a14ac8a94a7dcea66ad1288aa4c3635eae85"}
May 26 16:01:46.515111 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:46.515083    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:01:47.356770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:47.356731    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87r2b" event={"ID":"c3b148e7-c1e0-4215-8370-7707e59cbba2","Type":"ContainerStarted","Data":"e0002d18a0367cbd2f659eb957d241e71fddcb8e11ea9148e73a1a62aa801313"}
May 26 16:01:47.386703 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:47.386433    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-87r2b" podStartSLOduration=67.242157367 podStartE2EDuration="1m8.386414935s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:01:44.970653014 +0000 UTC m=+66.493235050" lastFinishedPulling="2026-05-26 16:01:46.11491058 +0000 UTC m=+67.637492618" observedRunningTime="2026-05-26 16:01:47.384133488 +0000 UTC m=+68.906715533" watchObservedRunningTime="2026-05-26 16:01:47.386414935 +0000 UTC m=+68.908996982"
May 26 16:01:55.382244 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.382200    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtfd5" event={"ID":"d3fb12b8-361b-4f71-b77f-1d495de4a679","Type":"ContainerStarted","Data":"584be11bf7dfaf260cd7e0fbf35c45704e0d4cf515d2b9d8d3c204e131f60588"}
May 26 16:01:55.382776 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.382394    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:01:55.383898 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.383840    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-wvfpf" event={"ID":"a357b4a5-225d-4366-92f3-6a017caa1257","Type":"ContainerStarted","Data":"3c5c7c9635d520835ed2611d4d8467a232aec2ac1f1b837651c891f387c6f2f7"}
May 26 16:01:55.384113 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.384082    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:55.400203 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.400177    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-wvfpf"
May 26 16:01:55.401312 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.401260    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jtfd5" podStartSLOduration=66.68392339 podStartE2EDuration="1m16.401245523s" podCreationTimestamp="2026-05-26 16:00:39 +0000 UTC" firstStartedPulling="2026-05-26 16:01:45.091890551 +0000 UTC m=+66.614472577" lastFinishedPulling="2026-05-26 16:01:54.809212674 +0000 UTC m=+76.331794710" observedRunningTime="2026-05-26 16:01:55.400592201 +0000 UTC m=+76.923174259" watchObservedRunningTime="2026-05-26 16:01:55.401245523 +0000 UTC m=+76.923827569"
May 26 16:01:55.422029 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:55.421972    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-wvfpf" podStartSLOduration=1.631166893 podStartE2EDuration="19.421953773s" podCreationTimestamp="2026-05-26 16:01:36 +0000 UTC" firstStartedPulling="2026-05-26 16:01:37.063304137 +0000 UTC m=+58.585886177" lastFinishedPulling="2026-05-26 16:01:54.85409102 +0000 UTC m=+76.376673057" observedRunningTime="2026-05-26 16:01:55.420513321 +0000 UTC m=+76.943095366" watchObservedRunningTime="2026-05-26 16:01:55.421953773 +0000 UTC m=+76.944535822"
May 26 16:01:59.378439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.378408    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:01:59.415481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.415447    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:01:59.415625 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.415577    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.417791 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.417768    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 16:01:59.417959 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.417768    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 16:01:59.417959 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.417806    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 16:01:59.418547 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.418520    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 16:01:59.418644 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.418625    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tf8sq\""
May 26 16:01:59.421182 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.419288    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 16:01:59.428719 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.428644    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 16:01:59.485506 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485474    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485569    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm25b\" (UniqueName: \"kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485588    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485611    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.485666 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.485638    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586037 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586003    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586054    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586085    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586112    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mm25b\" (UniqueName: \"kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586141    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586173    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586201    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.586988 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.586959    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.587123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.587022    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.587198 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.587118    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.587455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.587427    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.589084 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.589064    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.589529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.589506    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.595598 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.595577    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm25b\" (UniqueName: \"kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b\") pod \"console-676678bb56-f649r\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") " pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.694250 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.694215    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"]
May 26 16:01:59.722460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.722430    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"]
May 26 16:01:59.722460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.722456    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:01:59.724738 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.724717    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 16:01:59.724846 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.724743    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vjqng\""
May 26 16:01:59.732251 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.732231    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676678bb56-f649r"
May 26 16:01:59.788438 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.788311    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9jch4\" (UID: \"2e615563-9e82-4247-988e-a4a3609de933\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:01:59.876247 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.876193    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:01:59.881489 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:01:59.881449    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb6ccf8_31da_4216_bb51_855bd2e36f64.slice/crio-dc286aaf4e14e6439502a36295391e11c7f34d017de287cab01eb3858322afa7 WatchSource:0}: Error finding container dc286aaf4e14e6439502a36295391e11c7f34d017de287cab01eb3858322afa7: Status 404 returned error can't find the container with id dc286aaf4e14e6439502a36295391e11c7f34d017de287cab01eb3858322afa7
May 26 16:01:59.888932 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:01:59.888904    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9jch4\" (UID: \"2e615563-9e82-4247-988e-a4a3609de933\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:01:59.889074 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:59.889054    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 26 16:01:59.889136 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:01:59.889124    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates podName:2e615563-9e82-4247-988e-a4a3609de933 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:00.38910112 +0000 UTC m=+81.911683143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-9jch4" (UID: "2e615563-9e82-4247-988e-a4a3609de933") : secret "prometheus-operator-admission-webhook-tls" not found
May 26 16:02:00.393056 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:00.393015    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9jch4\" (UID: \"2e615563-9e82-4247-988e-a4a3609de933\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:02:00.396214 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:00.396184    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e615563-9e82-4247-988e-a4a3609de933-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-9jch4\" (UID: \"2e615563-9e82-4247-988e-a4a3609de933\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:02:00.401327 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:00.401230    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676678bb56-f649r" event={"ID":"5eb6ccf8-31da-4216-bb51-855bd2e36f64","Type":"ContainerStarted","Data":"dc286aaf4e14e6439502a36295391e11c7f34d017de287cab01eb3858322afa7"}
May 26 16:02:00.633832 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:00.633630    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:02:00.791063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:00.791020    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"]
May 26 16:02:00.797179 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:00.797147    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e615563_9e82_4247_988e_a4a3609de933.slice/crio-002b3500a046a0302edfc3611866cfab3c52f117a1cfe7f7e876db0a4f49d4be WatchSource:0}: Error finding container 002b3500a046a0302edfc3611866cfab3c52f117a1cfe7f7e876db0a4f49d4be: Status 404 returned error can't find the container with id 002b3500a046a0302edfc3611866cfab3c52f117a1cfe7f7e876db0a4f49d4be
May 26 16:02:01.405588 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:01.405533    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4" event={"ID":"2e615563-9e82-4247-988e-a4a3609de933","Type":"ContainerStarted","Data":"002b3500a046a0302edfc3611866cfab3c52f117a1cfe7f7e876db0a4f49d4be"}
May 26 16:02:01.528088 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:01.528029    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" containerName="registry" containerID="cri-o://79eaa21c4758597806de0ea928ca5a0c9c5612a3a2406ef28e1558fdf0643f94" gracePeriod=30
May 26 16:02:02.411599 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:02.411535    2547 generic.go:358] "Generic (PLEG): container finished" podID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" containerID="79eaa21c4758597806de0ea928ca5a0c9c5612a3a2406ef28e1558fdf0643f94" exitCode=0
May 26 16:02:02.412263 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:02.411913    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" event={"ID":"eb00bfbe-3d25-4308-9d15-a1ebf6673389","Type":"ContainerDied","Data":"79eaa21c4758597806de0ea928ca5a0c9c5612a3a2406ef28e1558fdf0643f94"}
May 26 16:02:03.631237 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.631211    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:02:03.723365 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723325    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723410    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq6kh\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723444    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723474    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723513    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723538    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.723620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.723572    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.724308 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.724092    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates\") pod \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\" (UID: \"eb00bfbe-3d25-4308-9d15-a1ebf6673389\") "
May 26 16:02:03.724412 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.724311    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:03.725283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.724516    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:03.726287 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.726262    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:02:03.726382 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.726283    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh" (OuterVolumeSpecName: "kube-api-access-jq6kh") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "kube-api-access-jq6kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:02:03.726382 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.726282    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:02:03.726492 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.726472    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:02:03.726717 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.726682    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:02:03.735075 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.735044    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eb00bfbe-3d25-4308-9d15-a1ebf6673389" (UID: "eb00bfbe-3d25-4308-9d15-a1ebf6673389"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:02:03.825175 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825144    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq6kh\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-kube-api-access-jq6kh\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825175 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825175    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825186    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-image-registry-private-configuration\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825195    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb00bfbe-3d25-4308-9d15-a1ebf6673389-bound-sa-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825205    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb00bfbe-3d25-4308-9d15-a1ebf6673389-installation-pull-secrets\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825213    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-trusted-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825226    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb00bfbe-3d25-4308-9d15-a1ebf6673389-registry-certificates\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:03.825336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:03.825240    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb00bfbe-3d25-4308-9d15-a1ebf6673389-ca-trust-extracted\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:04.419675 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.419639    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676678bb56-f649r" event={"ID":"5eb6ccf8-31da-4216-bb51-855bd2e36f64","Type":"ContainerStarted","Data":"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"}
May 26 16:02:04.421007 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.420974    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4" event={"ID":"2e615563-9e82-4247-988e-a4a3609de933","Type":"ContainerStarted","Data":"ef25dcd0ccde0b53aa6d82b8080087c00ad3d3ff0e21d46dc8a2f3800e80e997"}
May 26 16:02:04.421179 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.421165    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:02:04.422114 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.422091    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l" event={"ID":"eb00bfbe-3d25-4308-9d15-a1ebf6673389","Type":"ContainerDied","Data":"2f40e0739fb064c0516d2cf0d4f36e9e5f8c43afc9a70cd526f96b8eeffa4977"}
May 26 16:02:04.422224 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.422121    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5f98ff48-5vv2l"
May 26 16:02:04.422224 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.422133    2547 scope.go:117] "RemoveContainer" containerID="79eaa21c4758597806de0ea928ca5a0c9c5612a3a2406ef28e1558fdf0643f94"
May 26 16:02:04.426310 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.426292    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4"
May 26 16:02:04.439633 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.439589    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-676678bb56-f649r" podStartSLOduration=1.45535689 podStartE2EDuration="5.439572896s" podCreationTimestamp="2026-05-26 16:01:59 +0000 UTC" firstStartedPulling="2026-05-26 16:01:59.887172056 +0000 UTC m=+81.409754094" lastFinishedPulling="2026-05-26 16:02:03.871388075 +0000 UTC m=+85.393970100" observedRunningTime="2026-05-26 16:02:04.438635647 +0000 UTC m=+85.961217692" watchObservedRunningTime="2026-05-26 16:02:04.439572896 +0000 UTC m=+85.962154943"
May 26 16:02:04.453988 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.453951    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-9jch4" podStartSLOduration=2.38111334 podStartE2EDuration="5.453938112s" podCreationTimestamp="2026-05-26 16:01:59 +0000 UTC" firstStartedPulling="2026-05-26 16:02:00.799222599 +0000 UTC m=+82.321804622" lastFinishedPulling="2026-05-26 16:02:03.872047359 +0000 UTC m=+85.394629394" observedRunningTime="2026-05-26 16:02:04.453120507 +0000 UTC m=+85.975702556" watchObservedRunningTime="2026-05-26 16:02:04.453938112 +0000 UTC m=+85.976520157"
May 26 16:02:04.469649 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.469624    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:02:04.477323 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.477300    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f5f98ff48-5vv2l"]
May 26 16:02:04.755298 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.755219    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"]
May 26 16:02:04.755807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.755424    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" containerName="registry"
May 26 16:02:04.755807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.755434    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" containerName="registry"
May 26 16:02:04.755807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.755475    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" containerName="registry"
May 26 16:02:04.782458 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.782431    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"]
May 26 16:02:04.782600 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.782556    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.785095 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785076    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 16:02:04.785325 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785312    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ffgz4\""
May 26 16:02:04.785569 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785550    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 16:02:04.785816 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785802    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 26 16:02:04.785900 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785803    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 26 16:02:04.785900 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.785831    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 16:02:04.831157 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.831135    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.831266 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.831165    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.831266 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.831185    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng48l\" (UniqueName: \"kubernetes.io/projected/22ef5923-52ab-4994-b69d-4c5271aecd3c-kube-api-access-ng48l\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.831266 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.831207    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ef5923-52ab-4994-b69d-4c5271aecd3c-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.931776 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.931731    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.932167 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.931785    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.932167 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.931811    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ng48l\" (UniqueName: \"kubernetes.io/projected/22ef5923-52ab-4994-b69d-4c5271aecd3c-kube-api-access-ng48l\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.932167 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.931845    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ef5923-52ab-4994-b69d-4c5271aecd3c-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.932167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:04.931904    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 26 16:02:04.932167 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:04.931978    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls podName:22ef5923-52ab-4994-b69d-4c5271aecd3c nodeName:}" failed. No retries permitted until 2026-05-26 16:02:05.431956718 +0000 UTC m=+86.954538740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-c5pdz" (UID: "22ef5923-52ab-4994-b69d-4c5271aecd3c") : secret "prometheus-operator-tls" not found
May 26 16:02:04.932601 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.932580    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22ef5923-52ab-4994-b69d-4c5271aecd3c-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.934239 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.934220    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:04.941213 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:04.941191    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng48l\" (UniqueName: \"kubernetes.io/projected/22ef5923-52ab-4994-b69d-4c5271aecd3c-kube-api-access-ng48l\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:05.113561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:05.113488    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb00bfbe-3d25-4308-9d15-a1ebf6673389" path="/var/lib/kubelet/pods/eb00bfbe-3d25-4308-9d15-a1ebf6673389/volumes"
May 26 16:02:05.434989 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:05.434959    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:05.437276 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:05.437258    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22ef5923-52ab-4994-b69d-4c5271aecd3c-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c5pdz\" (UID: \"22ef5923-52ab-4994-b69d-4c5271aecd3c\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:05.691568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:05.691480    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"
May 26 16:02:05.813080 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:05.813049    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz"]
May 26 16:02:05.816463 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:05.816439    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ef5923_52ab_4994_b69d_4c5271aecd3c.slice/crio-6cca60d360bcb5f41280b956e7b229f838c7dbc1919e2e3629a99a6d547a2230 WatchSource:0}: Error finding container 6cca60d360bcb5f41280b956e7b229f838c7dbc1919e2e3629a99a6d547a2230: Status 404 returned error can't find the container with id 6cca60d360bcb5f41280b956e7b229f838c7dbc1919e2e3629a99a6d547a2230
May 26 16:02:06.432477 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:06.432441    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz" event={"ID":"22ef5923-52ab-4994-b69d-4c5271aecd3c","Type":"ContainerStarted","Data":"6cca60d360bcb5f41280b956e7b229f838c7dbc1919e2e3629a99a6d547a2230"}
May 26 16:02:08.438086 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:08.438046    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz" event={"ID":"22ef5923-52ab-4994-b69d-4c5271aecd3c","Type":"ContainerStarted","Data":"00716fa48d8e2d4a1f800846b1df7399df894291b3fd06d4ecc24b29a3a9822d"}
May 26 16:02:08.438086 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:08.438086    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz" event={"ID":"22ef5923-52ab-4994-b69d-4c5271aecd3c","Type":"ContainerStarted","Data":"a3c0d798f81b2c2cb445087b44d00810c753d34edc905b70f1d63338644b10d8"}
May 26 16:02:08.457227 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:08.457180    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c5pdz" podStartSLOduration=2.661175246 podStartE2EDuration="4.457166016s" podCreationTimestamp="2026-05-26 16:02:04 +0000 UTC" firstStartedPulling="2026-05-26 16:02:05.818397679 +0000 UTC m=+87.340979701" lastFinishedPulling="2026-05-26 16:02:07.614388449 +0000 UTC m=+89.136970471" observedRunningTime="2026-05-26 16:02:08.456470223 +0000 UTC m=+89.979052269" watchObservedRunningTime="2026-05-26 16:02:08.457166016 +0000 UTC m=+89.979748060"
May 26 16:02:09.732720 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:09.732680    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:09.733183 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:09.732759    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:09.737505 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:09.737485    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:10.447150 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:10.447119    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:13.938195 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.938160    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"]
May 26 16:02:13.961940 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.961915    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"]
May 26 16:02:13.961940 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.961946    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"]
May 26 16:02:13.962115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.962061    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:13.964938 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.964915    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 16:02:13.965345 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.965332    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 16:02:13.966164 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.966149    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4xspr\""
May 26 16:02:13.976784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.976761    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:13.977242 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.977181    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5fnss"]
May 26 16:02:13.981266 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.981250    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 16:02:13.981347 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.981311    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 16:02:13.981489 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.981477    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vmgdh\""
May 26 16:02:13.989583 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.989567    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 16:02:13.996834 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.996815    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"]
May 26 16:02:13.996987 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.996965    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:13.998942 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.998924    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wtsn\""
May 26 16:02:13.999278 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:13.999262    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 16:02:14.000386 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.000369    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 16:02:14.001119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.001104    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 16:02:14.095296 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095264    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.095296 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095297    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktpt9\" (UniqueName: \"kubernetes.io/projected/52eb65d4-a61e-445b-8cff-585861b13b58-kube-api-access-ktpt9\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.095481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095318    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmt9q\" (UniqueName: \"kubernetes.io/projected/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-api-access-nmt9q\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.095481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095333    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbgd\" (UniqueName: \"kubernetes.io/projected/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-kube-api-access-skbgd\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095353    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.095481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095400    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095499    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095528    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095550    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-metrics-client-ca\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095568    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-sys\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095608    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-textfile\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/890f8c25-22e6-4af0-9dae-efcdb7ea623a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095649    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095667    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52eb65d4-a61e-445b-8cff-585861b13b58-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095710    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-wtmp\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095730    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095743    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-root\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.095807 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.095759    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.196606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196528    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-sys\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.196606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196565    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.196606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196582    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-textfile\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.196606 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196606    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/890f8c25-22e6-4af0-9dae-efcdb7ea623a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196634    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196663    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52eb65d4-a61e-445b-8cff-585861b13b58-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196704    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-wtmp\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:14.196710    2547 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196731    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:14.196789    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls podName:d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:14.696766091 +0000 UTC m=+96.219348129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls") pod "node-exporter-5fnss" (UID: "d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0") : secret "node-exporter-tls" not found
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196861    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-wtmp\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.196965 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196950    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-root\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196987    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197006    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-textfile\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197021    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197068    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/890f8c25-22e6-4af0-9dae-efcdb7ea623a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.196634    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-sys\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197070    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktpt9\" (UniqueName: \"kubernetes.io/projected/52eb65d4-a61e-445b-8cff-585861b13b58-kube-api-access-ktpt9\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197141    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-root\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197143    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmt9q\" (UniqueName: \"kubernetes.io/projected/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-api-access-nmt9q\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197183    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skbgd\" (UniqueName: \"kubernetes.io/projected/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-kube-api-access-skbgd\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197215    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197247    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197313    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197353 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197347    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197375    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-metrics-client-ca\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:14.197411    2547 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:14.197477    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls podName:890f8c25-22e6-4af0-9dae-efcdb7ea623a nodeName:}" failed. No retries permitted until 2026-05-26 16:02:14.697447056 +0000 UTC m=+96.220029082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-p27nj" (UID: "890f8c25-22e6-4af0-9dae-efcdb7ea623a") : secret "kube-state-metrics-tls" not found
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197493    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197492    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52eb65d4-a61e-445b-8cff-585861b13b58-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.197999 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.197974    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-metrics-client-ca\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.198254 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.198136    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.198294 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.198266    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.199615 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.199589    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.199730 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.199592    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.199730 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.199718    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52eb65d4-a61e-445b-8cff-585861b13b58-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.199930 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.199914    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.207095 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.207071    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmt9q\" (UniqueName: \"kubernetes.io/projected/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-api-access-nmt9q\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.207610 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.207592    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktpt9\" (UniqueName: \"kubernetes.io/projected/52eb65d4-a61e-445b-8cff-585861b13b58-kube-api-access-ktpt9\") pod \"openshift-state-metrics-9c959559f-wmkx9\" (UID: \"52eb65d4-a61e-445b-8cff-585861b13b58\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.207992 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.207971    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbgd\" (UniqueName: \"kubernetes.io/projected/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-kube-api-access-skbgd\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.271196 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.271163    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"
May 26 16:02:14.401686 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.401650    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9"]
May 26 16:02:14.406028 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:14.405995    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52eb65d4_a61e_445b_8cff_585861b13b58.slice/crio-42f715d06250678d47338d74d3eb71397f788ec95fa5733f42b1838127967913 WatchSource:0}: Error finding container 42f715d06250678d47338d74d3eb71397f788ec95fa5733f42b1838127967913: Status 404 returned error can't find the container with id 42f715d06250678d47338d74d3eb71397f788ec95fa5733f42b1838127967913
May 26 16:02:14.453848 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.453817    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9" event={"ID":"52eb65d4-a61e-445b-8cff-585861b13b58","Type":"ContainerStarted","Data":"42f715d06250678d47338d74d3eb71397f788ec95fa5733f42b1838127967913"}
May 26 16:02:14.702073 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.702042    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.702180 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.702100    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.704438 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.704378    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0-node-exporter-tls\") pod \"node-exporter-5fnss\" (UID: \"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0\") " pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.704529 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.704442    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/890f8c25-22e6-4af0-9dae-efcdb7ea623a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-p27nj\" (UID: \"890f8c25-22e6-4af0-9dae-efcdb7ea623a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.886609 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.886577    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"
May 26 16:02:14.905686 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:14.905661    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fnss"
May 26 16:02:14.914160 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:14.914127    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd841e34e_1d0a_4155_bbf2_3a1ddf6e75a0.slice/crio-a021ed2d58a145e03811ecef9a9d0673a79c653b303976c6692e0445686f33cc WatchSource:0}: Error finding container a021ed2d58a145e03811ecef9a9d0673a79c653b303976c6692e0445686f33cc: Status 404 returned error can't find the container with id a021ed2d58a145e03811ecef9a9d0673a79c653b303976c6692e0445686f33cc
May 26 16:02:15.021448 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.021417    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj"]
May 26 16:02:15.024802 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:15.024776    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890f8c25_22e6_4af0_9dae_efcdb7ea623a.slice/crio-485bcbe8f77c3c74d1d92ba5b5e55170cdf21b7750a03f5e01965df89b585373 WatchSource:0}: Error finding container 485bcbe8f77c3c74d1d92ba5b5e55170cdf21b7750a03f5e01965df89b585373: Status 404 returned error can't find the container with id 485bcbe8f77c3c74d1d92ba5b5e55170cdf21b7750a03f5e01965df89b585373
May 26 16:02:15.029684 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.029660    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 16:02:15.055055 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.055020    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 16:02:15.055187 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.055159    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.057354 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057324    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hpq5r\""
May 26 16:02:15.057495 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057471    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 16:02:15.057595 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057560    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 16:02:15.057978 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057729    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 16:02:15.057978 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057819    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 16:02:15.057978 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.057853    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 16:02:15.058153 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.058096    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 16:02:15.058153 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.058097    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 16:02:15.058248 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.058148    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 16:02:15.058381 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.058353    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 16:02:15.206643 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206610    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pdjb\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-kube-api-access-2pdjb\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.206833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206654    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.206833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.206833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206711    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.206833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.206833 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206781    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206837    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-web-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206933    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-out\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.206976    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207119 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.207042    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.207310 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.207115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307469    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-web-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307524    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307561    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-out\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307588    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307616    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307642    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307675    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307704    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pdjb\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-kube-api-access-2pdjb\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307732    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307754    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307779    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307808    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.307934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.307849    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.309383 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.308614    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.309383 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:15.309338    2547 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 26 16:02:15.309559 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:15.309416    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls podName:7b0e412f-32d8-45b5-aa23-01911bf6c221 nodeName:}" failed. No retries permitted until 2026-05-26 16:02:15.809395336 +0000 UTC m=+97.331977371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7b0e412f-32d8-45b5-aa23-01911bf6c221") : secret "alertmanager-main-tls" not found
May 26 16:02:15.310794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.310746    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.311412 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.311386    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e412f-32d8-45b5-aa23-01911bf6c221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312029 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.311891    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312029 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.311891    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-out\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312168 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.312111    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312409 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.312386    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312526 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.312507    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.312621 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.312600    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.313135 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.313108    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-web-config\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.313315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.313297    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.318198 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.318180    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pdjb\" (UniqueName: \"kubernetes.io/projected/7b0e412f-32d8-45b5-aa23-01911bf6c221-kube-api-access-2pdjb\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.459331 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.459286    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fnss" event={"ID":"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0","Type":"ContainerStarted","Data":"a021ed2d58a145e03811ecef9a9d0673a79c653b303976c6692e0445686f33cc"}
May 26 16:02:15.460393 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.460360    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj" event={"ID":"890f8c25-22e6-4af0-9dae-efcdb7ea623a","Type":"ContainerStarted","Data":"485bcbe8f77c3c74d1d92ba5b5e55170cdf21b7750a03f5e01965df89b585373"}
May 26 16:02:15.462022 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.461995    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9" event={"ID":"52eb65d4-a61e-445b-8cff-585861b13b58","Type":"ContainerStarted","Data":"82ac3b784c3ed91270ad8797e0b457aca0189380f03029a10da60666afddef00"}
May 26 16:02:15.462104 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.462025    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9" event={"ID":"52eb65d4-a61e-445b-8cff-585861b13b58","Type":"ContainerStarted","Data":"b2070dc41a0e24f5f5c0c73716801916da41339ab1a91decba00d8265c2eea6a"}
May 26 16:02:15.813485 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.813456    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.816484 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.816458    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b0e412f-32d8-45b5-aa23-01911bf6c221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b0e412f-32d8-45b5-aa23-01911bf6c221\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:15.933585 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.933549    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64b848f74b-llhdr"]
May 26 16:02:15.951432 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.951385    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64b848f74b-llhdr"]
May 26 16:02:15.951611 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.951566    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:15.953705 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.953680    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 16:02:15.953990 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.953960    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 16:02:15.954205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.954187    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 16:02:15.954790 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.954606    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dalt4pa4sgvi0\""
May 26 16:02:15.954790 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.954668    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 16:02:15.954790 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.954668    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 16:02:15.954790 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.954744    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cb64t\""
May 26 16:02:15.964699 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:15.964678    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 16:02:16.014633 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.014824 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84041378-321e-4f57-92fc-eb0116bb1313-metrics-client-ca\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.014824 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014784    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.015028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014858    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.015028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014955    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-grpc-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.015028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.014989    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.015028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.015014    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsht6\" (UniqueName: \"kubernetes.io/projected/84041378-321e-4f57-92fc-eb0116bb1313-kube-api-access-xsht6\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.015234 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.015050    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116004 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.115920    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116004 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.115985    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84041378-321e-4f57-92fc-eb0116bb1313-metrics-client-ca\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116036    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116083    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116110    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-grpc-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116138    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116164    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsht6\" (UniqueName: \"kubernetes.io/projected/84041378-321e-4f57-92fc-eb0116bb1313-kube-api-access-xsht6\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.116561 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.116202    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.117110 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.117077    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84041378-321e-4f57-92fc-eb0116bb1313-metrics-client-ca\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.118958 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.118910    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.119616 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.119594    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-grpc-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.120077 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.119953    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.120344 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.120322    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-tls\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.120410 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.120349    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.120651 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.120623    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84041378-321e-4f57-92fc-eb0116bb1313-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.128092 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.128062    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsht6\" (UniqueName: \"kubernetes.io/projected/84041378-321e-4f57-92fc-eb0116bb1313-kube-api-access-xsht6\") pod \"thanos-querier-64b848f74b-llhdr\" (UID: \"84041378-321e-4f57-92fc-eb0116bb1313\") " pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:16.263519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:16.263494    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:17.353019 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.352984    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64b848f74b-llhdr"]
May 26 16:02:17.370016 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:17.369992    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84041378_321e_4f57_92fc_eb0116bb1313.slice/crio-53b06c313185c934343fd1a60b19c29266d48b76d1812a28fe479c9c5b315052 WatchSource:0}: Error finding container 53b06c313185c934343fd1a60b19c29266d48b76d1812a28fe479c9c5b315052: Status 404 returned error can't find the container with id 53b06c313185c934343fd1a60b19c29266d48b76d1812a28fe479c9c5b315052
May 26 16:02:17.386994 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.386939    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 16:02:17.469775 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.469740    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"53b06c313185c934343fd1a60b19c29266d48b76d1812a28fe479c9c5b315052"}
May 26 16:02:17.472910 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.472234    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9" event={"ID":"52eb65d4-a61e-445b-8cff-585861b13b58","Type":"ContainerStarted","Data":"63ae48c9a29944df290ff9447d7009ffa700afa5c3e151c86fea63e970a863f8"}
May 26 16:02:17.474195 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.474170    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"384fad2a718ad65240342709836256616737f357d3f334ea8a9aac4c01f20c6a"}
May 26 16:02:17.476539 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.476453    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fnss" event={"ID":"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0","Type":"ContainerStarted","Data":"cc79781f6a84128fb407495aa82c3df68914504fb022110897813f46d877ce79"}
May 26 16:02:17.478779 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.478751    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj" event={"ID":"890f8c25-22e6-4af0-9dae-efcdb7ea623a","Type":"ContainerStarted","Data":"0fbbb4e9327366cf6395ba1ce5b21d788ec172e629f4b1dff1a27058d60edde5"}
May 26 16:02:17.502417 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.502365    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-wmkx9" podStartSLOduration=1.996731355 podStartE2EDuration="4.502347748s" podCreationTimestamp="2026-05-26 16:02:13 +0000 UTC" firstStartedPulling="2026-05-26 16:02:14.675670048 +0000 UTC m=+96.198252071" lastFinishedPulling="2026-05-26 16:02:17.181286436 +0000 UTC m=+98.703868464" observedRunningTime="2026-05-26 16:02:17.500866982 +0000 UTC m=+99.023449030" watchObservedRunningTime="2026-05-26 16:02:17.502347748 +0000 UTC m=+99.024929798"
May 26 16:02:17.769249 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:17.769169    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zq4hz_1d6f4d6d-9768-4aab-af64-9afc90e04eb5/serve-healthcheck-canary/0.log"
May 26 16:02:18.402406 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.402373    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-648946bdf6-bxmkd"]
May 26 16:02:18.415332 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.415313    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.418177 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418151    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-648946bdf6-bxmkd"]
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418544    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418562    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418544    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418577    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5dc9nhdq7tc1a\""
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418633    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2rcqh\""
May 26 16:02:18.418710 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.418667    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 16:02:18.483838 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.483746    2547 generic.go:358] "Generic (PLEG): container finished" podID="d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0" containerID="cc79781f6a84128fb407495aa82c3df68914504fb022110897813f46d877ce79" exitCode=0
May 26 16:02:18.483838 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.483787    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fnss" event={"ID":"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0","Type":"ContainerDied","Data":"cc79781f6a84128fb407495aa82c3df68914504fb022110897813f46d877ce79"}
May 26 16:02:18.486012 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.485985    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj" event={"ID":"890f8c25-22e6-4af0-9dae-efcdb7ea623a","Type":"ContainerStarted","Data":"43d57df57319dd02244f8ccfe962d1ee015c2f3d1dc010be26a0b8315c1e44d0"}
May 26 16:02:18.486130 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.486021    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj" event={"ID":"890f8c25-22e6-4af0-9dae-efcdb7ea623a","Type":"ContainerStarted","Data":"c066b9de03239363f4a9048aaed42a89a969d2d69a241d05d286016fe24d2cbf"}
May 26 16:02:18.528280 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.528188    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-p27nj" podStartSLOduration=3.371057608 podStartE2EDuration="5.528170321s" podCreationTimestamp="2026-05-26 16:02:13 +0000 UTC" firstStartedPulling="2026-05-26 16:02:15.026714577 +0000 UTC m=+96.549296600" lastFinishedPulling="2026-05-26 16:02:17.183827271 +0000 UTC m=+98.706409313" observedRunningTime="2026-05-26 16:02:18.526157855 +0000 UTC m=+100.048739917" watchObservedRunningTime="2026-05-26 16:02:18.528170321 +0000 UTC m=+100.050752367"
May 26 16:02:18.537909 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.537867    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-tls\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538041 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.537932    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f495979-8319-4913-beb5-f17786d7f4cc-audit-log\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538041 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.537990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsjmb\" (UniqueName: \"kubernetes.io/projected/9f495979-8319-4913-beb5-f17786d7f4cc-kube-api-access-zsjmb\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538192 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.538057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-metrics-server-audit-profiles\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538192 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.538127    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538294 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.538191    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-client-certs\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.538294 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.538223    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-client-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.639478 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639415    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-tls\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.639632 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639494    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f495979-8319-4913-beb5-f17786d7f4cc-audit-log\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.639762 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639733    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsjmb\" (UniqueName: \"kubernetes.io/projected/9f495979-8319-4913-beb5-f17786d7f4cc-kube-api-access-zsjmb\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.639906 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639837    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-metrics-server-audit-profiles\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.639977 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639929    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f495979-8319-4913-beb5-f17786d7f4cc-audit-log\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.640035 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.639986    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.640087 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.640065    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-client-certs\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.640148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.640102    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-client-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.640948 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.640889    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-metrics-server-audit-profiles\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.641207 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.641166    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f495979-8319-4913-beb5-f17786d7f4cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.643271 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.643250    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-tls\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.643708 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.643673    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-client-ca-bundle\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.643960 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.643938    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f495979-8319-4913-beb5-f17786d7f4cc-secret-metrics-server-client-certs\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.649055 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.649031    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsjmb\" (UniqueName: \"kubernetes.io/projected/9f495979-8319-4913-beb5-f17786d7f4cc-kube-api-access-zsjmb\") pod \"metrics-server-648946bdf6-bxmkd\" (UID: \"9f495979-8319-4913-beb5-f17786d7f4cc\") " pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.725762 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.725723    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:18.743138 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.743101    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:02:18.767046 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.767001    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:02:18.767332 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.767309    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.848914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848650    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.848914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848740    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.848914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.848914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848822    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stb7q\" (UniqueName: \"kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.848914 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.849189 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848916    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.849189 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.848979    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950068 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950033    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950229 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950077    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950229 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950098    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stb7q\" (UniqueName: \"kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950229 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950117    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950229 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950145    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950687 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950652    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950693    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950763    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.950934 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.950864    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.952117 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.951932    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.952246 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.952173    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.953039 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.952998    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.957968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.957946    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.966641 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.966550    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-648946bdf6-bxmkd"]
May 26 16:02:18.968227 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:18.968178    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stb7q\" (UniqueName: \"kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q\") pod \"console-846fb54fd8-m4rk2\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") " pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:18.971076 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:18.971046    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f495979_8319_4913_beb5_f17786d7f4cc.slice/crio-61549d2a03e387e5db6928372376e45900323c7a5a9221ca8ecfa1174f6f509f WatchSource:0}: Error finding container 61549d2a03e387e5db6928372376e45900323c7a5a9221ca8ecfa1174f6f509f: Status 404 returned error can't find the container with id 61549d2a03e387e5db6928372376e45900323c7a5a9221ca8ecfa1174f6f509f
May 26 16:02:19.079165 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.079104    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:19.491611 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.491568    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fnss" event={"ID":"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0","Type":"ContainerStarted","Data":"636113c9a4420a3ae197bdebb81031b3e5d56043afb7f06bebc371b985a2e73c"}
May 26 16:02:19.492101 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.491619    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fnss" event={"ID":"d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0","Type":"ContainerStarted","Data":"d87c9cd7776cfda69a5d148b8349be4036b166a8e3a5e0571800d66d422f6615"}
May 26 16:02:19.492968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.492934    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd" event={"ID":"9f495979-8319-4913-beb5-f17786d7f4cc","Type":"ContainerStarted","Data":"61549d2a03e387e5db6928372376e45900323c7a5a9221ca8ecfa1174f6f509f"}
May 26 16:02:19.518608 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.518551    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5fnss" podStartSLOduration=4.25192402 podStartE2EDuration="6.518534326s" podCreationTimestamp="2026-05-26 16:02:13 +0000 UTC" firstStartedPulling="2026-05-26 16:02:14.915984328 +0000 UTC m=+96.438566351" lastFinishedPulling="2026-05-26 16:02:17.182594614 +0000 UTC m=+98.705176657" observedRunningTime="2026-05-26 16:02:19.516673667 +0000 UTC m=+101.039255713" watchObservedRunningTime="2026-05-26 16:02:19.518534326 +0000 UTC m=+101.041116371"
May 26 16:02:19.932866 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:19.932838    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:02:19.935980 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:19.935938    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3235d670_1abf_481b_8a7e_504b6ccd7fa1.slice/crio-016e12f975eaec79d75319d03f2a134a126b76a0eb2cffec5ebe7a1f3005c8c8 WatchSource:0}: Error finding container 016e12f975eaec79d75319d03f2a134a126b76a0eb2cffec5ebe7a1f3005c8c8: Status 404 returned error can't find the container with id 016e12f975eaec79d75319d03f2a134a126b76a0eb2cffec5ebe7a1f3005c8c8
May 26 16:02:20.250404 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.250340    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 16:02:20.273834 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.272618    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 16:02:20.273834 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.272683    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.282611 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.282090    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 16:02:20.283110 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.282752    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 16:02:20.285576 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.284348    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f809ql4m8mvqh\""
May 26 16:02:20.285576 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.284795    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 16:02:20.285576 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.284934    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.287607    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.287908    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.290227    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.290392    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.291406    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.291437    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 16:02:20.292205 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.291590    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-szxlc\""
May 26 16:02:20.293314 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.293140    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 16:02:20.305178 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.305152    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 16:02:20.365057 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365163 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365079    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365163 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365290 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365170    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365290 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365196    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365398 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365302    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365398 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365353    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365398 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365385    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365516 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365411    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365516 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365438    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365516 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365480    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-548w5\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-kube-api-access-548w5\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365681 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365528    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365681 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365555    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365681 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365643    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365827 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365827 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365704    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365827 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365745    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.365827 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.365768    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.466910 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.466838    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.466916    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.466948    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.466977    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467016    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467040    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467065    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467120    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467186    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467212    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467237    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467263    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467315 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467288    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-548w5\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-kube-api-access-548w5\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467325    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467350    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467395    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467434    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.467659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.467459    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.468449 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.468292    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.469590 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.469488    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.472054 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.471701    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.472054 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.471912    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.473044 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.472693    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.473651 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.473629    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.475887 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.475848    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f92ad8-051f-455c-b3a5-7fecbb754a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.477092 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.476731    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.479381 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.479339    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.484537 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.484462    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.486218 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.486169    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.486365 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.486333    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.488988 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.487624    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.488988 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.488134    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.489794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.489406    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.489794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.489762    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.490363 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.490337    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f92ad8-051f-455c-b3a5-7fecbb754a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.496505 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.496482    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-548w5\" (UniqueName: \"kubernetes.io/projected/b9f92ad8-051f-455c-b3a5-7fecbb754a55-kube-api-access-548w5\") pod \"prometheus-k8s-0\" (UID: \"b9f92ad8-051f-455c-b3a5-7fecbb754a55\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.500946 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.500767    2547 generic.go:358] "Generic (PLEG): container finished" podID="7b0e412f-32d8-45b5-aa23-01911bf6c221" containerID="08641094f9338a6b2378ab894a21e5f4ed7d61abb4fdc39978bb4f2d4ecca2e6" exitCode=0
May 26 16:02:20.502248 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.502201    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerDied","Data":"08641094f9338a6b2378ab894a21e5f4ed7d61abb4fdc39978bb4f2d4ecca2e6"}
May 26 16:02:20.509063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.509039    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"52eb45a8bc997080b90be748acfbe82c386c52521b28dec4b978391e815721d0"}
May 26 16:02:20.509185 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.509169    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"86dbde4b722c2dfc98d3650e47bba25b617ac0fafb89305b12f196cc421597a7"}
May 26 16:02:20.512235 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.512201    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846fb54fd8-m4rk2" event={"ID":"3235d670-1abf-481b-8a7e-504b6ccd7fa1","Type":"ContainerStarted","Data":"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"}
May 26 16:02:20.512235 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.512232    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846fb54fd8-m4rk2" event={"ID":"3235d670-1abf-481b-8a7e-504b6ccd7fa1","Type":"ContainerStarted","Data":"016e12f975eaec79d75319d03f2a134a126b76a0eb2cffec5ebe7a1f3005c8c8"}
May 26 16:02:20.594141 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.594089    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-846fb54fd8-m4rk2" podStartSLOduration=2.594070641 podStartE2EDuration="2.594070641s" podCreationTimestamp="2026-05-26 16:02:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:02:20.592724614 +0000 UTC m=+102.115306661" watchObservedRunningTime="2026-05-26 16:02:20.594070641 +0000 UTC m=+102.116652687"
May 26 16:02:20.598000 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.597979    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:20.810898 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:20.810817    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 16:02:20.814464 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:02:20.814434    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f92ad8_051f_455c_b3a5_7fecbb754a55.slice/crio-efa8a9a801738e9d5f23b5dad67e5cc9ed341a99efb586be54beb14dfedfd699 WatchSource:0}: Error finding container efa8a9a801738e9d5f23b5dad67e5cc9ed341a99efb586be54beb14dfedfd699: Status 404 returned error can't find the container with id efa8a9a801738e9d5f23b5dad67e5cc9ed341a99efb586be54beb14dfedfd699
May 26 16:02:21.515657 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.515615    2547 generic.go:358] "Generic (PLEG): container finished" podID="b9f92ad8-051f-455c-b3a5-7fecbb754a55" containerID="95b220f72b825249662d40935aa48a57a01b8000cdfd55d66a64d1120f0052ae" exitCode=0
May 26 16:02:21.516097 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.515770    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerDied","Data":"95b220f72b825249662d40935aa48a57a01b8000cdfd55d66a64d1120f0052ae"}
May 26 16:02:21.516097 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.515803    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"efa8a9a801738e9d5f23b5dad67e5cc9ed341a99efb586be54beb14dfedfd699"}
May 26 16:02:21.518378 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.518339    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"eafe0444c4a589dd42fddc9d280ba7d992f071154ff3acde0289c7d4f4727839"}
May 26 16:02:21.520018 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.519982    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd" event={"ID":"9f495979-8319-4913-beb5-f17786d7f4cc","Type":"ContainerStarted","Data":"bc7db9a647c9102a93da3313365e9101996ad73377cebece47d4538004cb3286"}
May 26 16:02:21.625531 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:21.625417    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd" podStartSLOduration=1.262270389 podStartE2EDuration="3.62539673s" podCreationTimestamp="2026-05-26 16:02:18 +0000 UTC" firstStartedPulling="2026-05-26 16:02:18.973286773 +0000 UTC m=+100.495868796" lastFinishedPulling="2026-05-26 16:02:21.336413114 +0000 UTC m=+102.858995137" observedRunningTime="2026-05-26 16:02:21.622899578 +0000 UTC m=+103.145481623" watchObservedRunningTime="2026-05-26 16:02:21.62539673 +0000 UTC m=+103.147978780"
May 26 16:02:22.527542 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:22.527501    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"9b0feff4b8c2dbb8c28839a8961dbc2867cefffbd09f21e745b1fa8c268f2821"}
May 26 16:02:22.527542 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:22.527543    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"3b163e93fdf2d358e9ec31ab625b681d15a0833d458d943483dc1ee0e924790c"}
May 26 16:02:22.528073 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:22.527556    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" event={"ID":"84041378-321e-4f57-92fc-eb0116bb1313","Type":"ContainerStarted","Data":"6babf0a424c96ef5879c904bc7eb192858575d1d278bfdf47b92c6640f368eeb"}
May 26 16:02:22.528073 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:22.527697    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:23.533917 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533861    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"98709325ffb7ab4ffad3a9019b67c07d26aaba511e443eafcf3bb3087f52ce33"}
May 26 16:02:23.533917 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533924    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"e7c6704929ab968dd7d36f3821fe05a484311dba9c5bc6bdb249f0bc9b7f79cb"}
May 26 16:02:23.534390 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533940    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"dba0c427f1313ce1cf631ed55cfe0db93a05f57030908d34c6e396c34b3b3da2"}
May 26 16:02:23.534390 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533954    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"8ed9b24dfc35f7928b5abae9d1e57e10161c82fbf83ad0861fbaef2c2a9765da"}
May 26 16:02:23.534390 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533966    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"a10010a706a42d53f91ad755f60344af8e8b73acccbc31175cb5ad2ababcbef9"}
May 26 16:02:23.534390 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.533977    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b0e412f-32d8-45b5-aa23-01911bf6c221","Type":"ContainerStarted","Data":"06f8b29e5cfbab0b998cee1f3132acddebd62a3d984c518675522ff080981f03"}
May 26 16:02:23.583334 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.583182    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.281550878 podStartE2EDuration="8.58316237s" podCreationTimestamp="2026-05-26 16:02:15 +0000 UTC" firstStartedPulling="2026-05-26 16:02:17.395862385 +0000 UTC m=+98.918444414" lastFinishedPulling="2026-05-26 16:02:22.697473882 +0000 UTC m=+104.220055906" observedRunningTime="2026-05-26 16:02:23.583144892 +0000 UTC m=+105.105726959" watchObservedRunningTime="2026-05-26 16:02:23.58316237 +0000 UTC m=+105.105744416"
May 26 16:02:23.583497 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:23.583472    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr" podStartSLOduration=4.129837294 podStartE2EDuration="8.583459763s" podCreationTimestamp="2026-05-26 16:02:15 +0000 UTC" firstStartedPulling="2026-05-26 16:02:17.371998696 +0000 UTC m=+98.894580719" lastFinishedPulling="2026-05-26 16:02:21.825621164 +0000 UTC m=+103.348203188" observedRunningTime="2026-05-26 16:02:22.594461811 +0000 UTC m=+104.117043867" watchObservedRunningTime="2026-05-26 16:02:23.583459763 +0000 UTC m=+105.106041809"
May 26 16:02:25.547577 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:25.547544    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"f0df13203ebcabc17494dc40b01a84fe37d779fdf231788b2db8a50e8e5d8a20"}
May 26 16:02:25.547577 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:25.547581    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"0607c7bcfdfbebe43302f66fd5d96e6e4b5f3f23abb14974f2edbe94595eb1f3"}
May 26 16:02:26.389572 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.389500    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jtfd5"
May 26 16:02:26.553778 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.553743    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"312a9a528df34865199907971167f3c0c25cfbea1fd376e3f91d7e6d41d99e94"}
May 26 16:02:26.553778 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.553780    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"f35ee72c5312fa36413fb7383352a4ca14839c44cda7c37be7c2f807b462b66d"}
May 26 16:02:26.554184 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.553796    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"4b40b2fe6b772ab56e4a16f10fd6079775b0744d9a69c121f85265720b3d7bd6"}
May 26 16:02:26.554184 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.553807    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9f92ad8-051f-455c-b3a5-7fecbb754a55","Type":"ContainerStarted","Data":"781a93f0b7a3283e290892eecb51e2d3fdbeab5276644dbf671db66d41517c99"}
May 26 16:02:26.608765 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:26.608709    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.011884299 podStartE2EDuration="6.608690226s" podCreationTimestamp="2026-05-26 16:02:20 +0000 UTC" firstStartedPulling="2026-05-26 16:02:21.517340053 +0000 UTC m=+103.039922083" lastFinishedPulling="2026-05-26 16:02:25.114145974 +0000 UTC m=+106.636728010" observedRunningTime="2026-05-26 16:02:26.607785751 +0000 UTC m=+108.130367814" watchObservedRunningTime="2026-05-26 16:02:26.608690226 +0000 UTC m=+108.131272274"
May 26 16:02:28.540144 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:28.540113    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64b848f74b-llhdr"
May 26 16:02:29.080237 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:29.080206    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:29.080237 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:29.080242    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:29.085225 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:29.085202    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:29.568067 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:29.568037    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:02:29.654717 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:29.654676    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:02:30.598564 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:30.598532    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:02:38.726718 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:38.726687    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:38.726718 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:38.726727    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:54.682568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.682505    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-676678bb56-f649r" podUID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" containerName="console" containerID="cri-o://aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650" gracePeriod=15
May 26 16:02:54.927481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.923564    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-676678bb56-f649r_5eb6ccf8-31da-4216-bb51-855bd2e36f64/console/0.log"
May 26 16:02:54.927481 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.923660    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:54.965643 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965572    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.965643 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965630    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.965818 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965668    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.965818 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965694    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.965818 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965735    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.965818 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965795    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm25b\" (UniqueName: \"kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.966041 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965849    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle\") pod \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\" (UID: \"5eb6ccf8-31da-4216-bb51-855bd2e36f64\") "
May 26 16:02:54.966094 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.966039    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca" (OuterVolumeSpecName: "service-ca") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:54.966094 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.965993    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:54.966215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.966188    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-oauth-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:54.966215 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.966212    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:54.966761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.966163    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config" (OuterVolumeSpecName: "console-config") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:54.966761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.966390    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:02:54.968262 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.968238    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b" (OuterVolumeSpecName: "kube-api-access-mm25b") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "kube-api-access-mm25b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:02:54.968357 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.968344    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:02:54.968414 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:54.968366    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5eb6ccf8-31da-4216-bb51-855bd2e36f64" (UID: "5eb6ccf8-31da-4216-bb51-855bd2e36f64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:02:55.067475 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.067436    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:55.067475 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.067472    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm25b\" (UniqueName: \"kubernetes.io/projected/5eb6ccf8-31da-4216-bb51-855bd2e36f64-kube-api-access-mm25b\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:55.067475 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.067483    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb6ccf8-31da-4216-bb51-855bd2e36f64-trusted-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:55.067692 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.067493    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-oauth-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:55.067692 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.067502    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb6ccf8-31da-4216-bb51-855bd2e36f64-console-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:02:55.652475 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652453    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-676678bb56-f649r_5eb6ccf8-31da-4216-bb51-855bd2e36f64/console/0.log"
May 26 16:02:55.652636 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652490    2547 generic.go:358] "Generic (PLEG): container finished" podID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" containerID="aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650" exitCode=2
May 26 16:02:55.652636 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652524    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676678bb56-f649r" event={"ID":"5eb6ccf8-31da-4216-bb51-855bd2e36f64","Type":"ContainerDied","Data":"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"}
May 26 16:02:55.652636 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652568    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676678bb56-f649r" event={"ID":"5eb6ccf8-31da-4216-bb51-855bd2e36f64","Type":"ContainerDied","Data":"dc286aaf4e14e6439502a36295391e11c7f34d017de287cab01eb3858322afa7"}
May 26 16:02:55.652636 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652583    2547 scope.go:117] "RemoveContainer" containerID="aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"
May 26 16:02:55.652636 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.652584    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676678bb56-f649r"
May 26 16:02:55.661133 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.661116    2547 scope.go:117] "RemoveContainer" containerID="aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"
May 26 16:02:55.661375 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:02:55.661357    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650\": container with ID starting with aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650 not found: ID does not exist" containerID="aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"
May 26 16:02:55.661432 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.661381    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650"} err="failed to get container status \"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650\": rpc error: code = NotFound desc = could not find container \"aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650\": container with ID starting with aa9152a489d26cb387cc8d39f18d764cbee311fee9f8bfcda487714af2bb5650 not found: ID does not exist"
May 26 16:02:55.675757 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.675736    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:02:55.680096 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:55.680074    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-676678bb56-f649r"]
May 26 16:02:57.114387 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:57.114356    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" path="/var/lib/kubelet/pods/5eb6ccf8-31da-4216-bb51-855bd2e36f64/volumes"
May 26 16:02:58.731259 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:58.731228    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:02:58.735033 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:02:58.735010    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-648946bdf6-bxmkd"
May 26 16:03:20.599087 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:03:20.599037    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:03:20.617841 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:03:20.617814    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:03:20.736898 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:03:20.736856    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 16:03:53.419571 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:03:53.419540    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:04:18.443495 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.443446    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-846fb54fd8-m4rk2" podUID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" containerName="console" containerID="cri-o://76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f" gracePeriod=15
May 26 16:04:18.589410 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.589378    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9dvk5"]
May 26 16:04:18.589866 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.589849    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" containerName="console"
May 26 16:04:18.589938 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.589887    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" containerName="console"
May 26 16:04:18.590002 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.589990    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="5eb6ccf8-31da-4216-bb51-855bd2e36f64" containerName="console"
May 26 16:04:18.591993 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.591974    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.593843 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.593826    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 16:04:18.600157 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.600124    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dvk5"]
May 26 16:04:18.697039 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.696985    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-846fb54fd8-m4rk2_3235d670-1abf-481b-8a7e-504b6ccd7fa1/console/0.log"
May 26 16:04:18.697137 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.697045    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:04:18.703622 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.703597    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8623ad55-8f86-4a13-8245-c406043e60f7-original-pull-secret\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.703741 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.703656    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-kubelet-config\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.703741 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.703719    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-dbus\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.804748 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.804723    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.804748 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.804752    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.804968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.804781    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.804968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.804798    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.804968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.804928    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.805105 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805032    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stb7q\" (UniqueName: \"kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.805105 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805072    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config\") pod \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\" (UID: \"3235d670-1abf-481b-8a7e-504b6ccd7fa1\") "
May 26 16:04:18.805269 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805241    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:18.805356 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805270    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:18.805356 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805277    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8623ad55-8f86-4a13-8245-c406043e60f7-original-pull-secret\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.805356 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805326    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-kubelet-config\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.805519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805400    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-dbus\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.805519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805471    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-trusted-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.805519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805486    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-oauth-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.805519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805488    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config" (OuterVolumeSpecName: "console-config") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:18.805519 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805503    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-kubelet-config\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.805761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805622    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8623ad55-8f86-4a13-8245-c406043e60f7-dbus\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.805761 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.805733    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca" (OuterVolumeSpecName: "service-ca") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:04:18.807133 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.807109    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q" (OuterVolumeSpecName: "kube-api-access-stb7q") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "kube-api-access-stb7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:04:18.807133 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.807120    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:04:18.807274 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.807229    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3235d670-1abf-481b-8a7e-504b6ccd7fa1" (UID: "3235d670-1abf-481b-8a7e-504b6ccd7fa1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:04:18.807535 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.807518    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8623ad55-8f86-4a13-8245-c406043e60f7-original-pull-secret\") pod \"global-pull-secret-syncer-9dvk5\" (UID: \"8623ad55-8f86-4a13-8245-c406043e60f7\") " pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.887986 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.887964    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-846fb54fd8-m4rk2_3235d670-1abf-481b-8a7e-504b6ccd7fa1/console/0.log"
May 26 16:04:18.888115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.887998    2547 generic.go:358] "Generic (PLEG): container finished" podID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" containerID="76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f" exitCode=2
May 26 16:04:18.888115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.888064    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846fb54fd8-m4rk2"
May 26 16:04:18.888115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.888087    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846fb54fd8-m4rk2" event={"ID":"3235d670-1abf-481b-8a7e-504b6ccd7fa1","Type":"ContainerDied","Data":"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"}
May 26 16:04:18.888218 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.888124    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846fb54fd8-m4rk2" event={"ID":"3235d670-1abf-481b-8a7e-504b6ccd7fa1","Type":"ContainerDied","Data":"016e12f975eaec79d75319d03f2a134a126b76a0eb2cffec5ebe7a1f3005c8c8"}
May 26 16:04:18.888218 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.888145    2547 scope.go:117] "RemoveContainer" containerID="76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"
May 26 16:04:18.896033 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.896017    2547 scope.go:117] "RemoveContainer" containerID="76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"
May 26 16:04:18.896395 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:04:18.896357    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f\": container with ID starting with 76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f not found: ID does not exist" containerID="76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"
May 26 16:04:18.896505 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.896399    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f"} err="failed to get container status \"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f\": rpc error: code = NotFound desc = could not find container \"76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f\": container with ID starting with 76a5808c7ffa2c95bb61f4bb73aa11e4fcb07bf15c658f8325924b7ac0e1cd1f not found: ID does not exist"
May 26 16:04:18.902565 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.901486    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dvk5"
May 26 16:04:18.907371 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.907342    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stb7q\" (UniqueName: \"kubernetes.io/projected/3235d670-1abf-481b-8a7e-504b6ccd7fa1-kube-api-access-stb7q\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.907461 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.907378    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.907461 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.907394    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.907461 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.907413    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3235d670-1abf-481b-8a7e-504b6ccd7fa1-console-oauth-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.907461 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.907427    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3235d670-1abf-481b-8a7e-504b6ccd7fa1-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:04:18.913565 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.913539    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:04:18.918762 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:18.918741    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846fb54fd8-m4rk2"]
May 26 16:04:19.031099 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:19.031075    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dvk5"]
May 26 16:04:19.033636 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:04:19.033605    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8623ad55_8f86_4a13_8245_c406043e60f7.slice/crio-957590fb79db0f536b1b739d912d9ec9b88ea705540a4f5d3e9e8e7859dae517 WatchSource:0}: Error finding container 957590fb79db0f536b1b739d912d9ec9b88ea705540a4f5d3e9e8e7859dae517: Status 404 returned error can't find the container with id 957590fb79db0f536b1b739d912d9ec9b88ea705540a4f5d3e9e8e7859dae517
May 26 16:04:19.114614 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:19.114583    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" path="/var/lib/kubelet/pods/3235d670-1abf-481b-8a7e-504b6ccd7fa1/volumes"
May 26 16:04:19.892153 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:19.892118    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dvk5" event={"ID":"8623ad55-8f86-4a13-8245-c406043e60f7","Type":"ContainerStarted","Data":"957590fb79db0f536b1b739d912d9ec9b88ea705540a4f5d3e9e8e7859dae517"}
May 26 16:04:22.904584 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:22.904551    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dvk5" event={"ID":"8623ad55-8f86-4a13-8245-c406043e60f7","Type":"ContainerStarted","Data":"edd6902f4e17e3384fa1ee80a81afbc246e5b28bf4a2078d8d3d06797dad4fe2"}
May 26 16:04:22.923214 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:04:22.923170    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9dvk5" podStartSLOduration=1.276062407 podStartE2EDuration="4.923155226s" podCreationTimestamp="2026-05-26 16:04:18 +0000 UTC" firstStartedPulling="2026-05-26 16:04:19.035198581 +0000 UTC m=+220.557780603" lastFinishedPulling="2026-05-26 16:04:22.682291385 +0000 UTC m=+224.204873422" observedRunningTime="2026-05-26 16:04:22.920963358 +0000 UTC m=+224.443545413" watchObservedRunningTime="2026-05-26 16:04:22.923155226 +0000 UTC m=+224.445737271"
May 26 16:05:38.998241 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:05:38.998211    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:05:38.998736 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:05:38.998549    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:05:39.004305 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:05:39.004285    2547 kubelet.go:1628] "Image garbage collection succeeded"
May 26 16:07:12.531797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.531764    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6f7545b5b9-mj45m"]
May 26 16:07:12.532370 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.532125    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" containerName="console"
May 26 16:07:12.532370 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.532137    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" containerName="console"
May 26 16:07:12.532370 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.532186    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="3235d670-1abf-481b-8a7e-504b6ccd7fa1" containerName="console"
May 26 16:07:12.534638 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.534621    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.536497 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.536471    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 26 16:07:12.536589 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.536549    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 26 16:07:12.537065 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.537048    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-5k26f\""
May 26 16:07:12.537142 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.537128    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 26 16:07:12.543239 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.543218    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f7545b5b9-mj45m"]
May 26 16:07:12.667143 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.667110    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nscts\" (UniqueName: \"kubernetes.io/projected/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-kube-api-access-nscts\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.667304 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.667203    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-cert\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.767930 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.767894    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-cert\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.768089 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.767942    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nscts\" (UniqueName: \"kubernetes.io/projected/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-kube-api-access-nscts\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.770465 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.770435    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-cert\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.776949 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.776923    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nscts\" (UniqueName: \"kubernetes.io/projected/47a2bbd7-70d1-429b-b9f8-686914bd0ed4-kube-api-access-nscts\") pod \"kserve-controller-manager-6f7545b5b9-mj45m\" (UID: \"47a2bbd7-70d1-429b-b9f8-686914bd0ed4\") " pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.845106 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.845034    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:12.970028 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.970006    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6f7545b5b9-mj45m"]
May 26 16:07:12.972759 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:07:12.972727    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a2bbd7_70d1_429b_b9f8_686914bd0ed4.slice/crio-80495c5557e8fd55e30da6a722cf48a64ec5dd1d70ba9ed339eced3034b2f218 WatchSource:0}: Error finding container 80495c5557e8fd55e30da6a722cf48a64ec5dd1d70ba9ed339eced3034b2f218: Status 404 returned error can't find the container with id 80495c5557e8fd55e30da6a722cf48a64ec5dd1d70ba9ed339eced3034b2f218
May 26 16:07:12.974009 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:12.973995    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:07:13.396514 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:13.396480    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m" event={"ID":"47a2bbd7-70d1-429b-b9f8-686914bd0ed4","Type":"ContainerStarted","Data":"80495c5557e8fd55e30da6a722cf48a64ec5dd1d70ba9ed339eced3034b2f218"}
May 26 16:07:16.407572 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:16.407536    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m" event={"ID":"47a2bbd7-70d1-429b-b9f8-686914bd0ed4","Type":"ContainerStarted","Data":"a846cc239bfc41f16a0022e4df598d775eaa82147ecc91ed592c0b45df11bd69"}
May 26 16:07:16.407970 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:16.407651    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:07:16.425320 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:16.425266    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m" podStartSLOduration=1.869939049 podStartE2EDuration="4.42524701s" podCreationTimestamp="2026-05-26 16:07:12 +0000 UTC" firstStartedPulling="2026-05-26 16:07:12.974112587 +0000 UTC m=+394.496694610" lastFinishedPulling="2026-05-26 16:07:15.529420545 +0000 UTC m=+397.052002571" observedRunningTime="2026-05-26 16:07:16.423911731 +0000 UTC m=+397.946493773" watchObservedRunningTime="2026-05-26 16:07:16.42524701 +0000 UTC m=+397.947829056"
May 26 16:07:47.415683 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:07:47.415647    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6f7545b5b9-mj45m"
May 26 16:08:04.902009 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:04.901927    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-8hpz7"]
May 26 16:08:04.904008 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:04.903991    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8hpz7"
May 26 16:08:04.906108 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:04.906088    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-5qt54\""
May 26 16:08:04.906256 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:04.906235    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
May 26 16:08:04.912150 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:04.912131    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8hpz7"]
May 26 16:08:05.019124 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.019093    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2l85\" (UniqueName: \"kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85\") pod \"s3-init-8hpz7\" (UID: \"fe6effb7-5fd5-4173-9643-2736e6790219\") " pod="kserve/s3-init-8hpz7"
May 26 16:08:05.120193 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.120162    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2l85\" (UniqueName: \"kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85\") pod \"s3-init-8hpz7\" (UID: \"fe6effb7-5fd5-4173-9643-2736e6790219\") " pod="kserve/s3-init-8hpz7"
May 26 16:08:05.129611 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.129585    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2l85\" (UniqueName: \"kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85\") pod \"s3-init-8hpz7\" (UID: \"fe6effb7-5fd5-4173-9643-2736e6790219\") " pod="kserve/s3-init-8hpz7"
May 26 16:08:05.226464 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.226434    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8hpz7"
May 26 16:08:05.354657 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.354626    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8hpz7"]
May 26 16:08:05.359196 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:08:05.359164    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe6effb7_5fd5_4173_9643_2736e6790219.slice/crio-a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3 WatchSource:0}: Error finding container a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3: Status 404 returned error can't find the container with id a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3
May 26 16:08:05.551421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:05.551345    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8hpz7" event={"ID":"fe6effb7-5fd5-4173-9643-2736e6790219","Type":"ContainerStarted","Data":"a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3"}
May 26 16:08:10.567717 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:10.567670    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8hpz7" event={"ID":"fe6effb7-5fd5-4173-9643-2736e6790219","Type":"ContainerStarted","Data":"f2e87f05ddc60af902b43ddda6f5d5774acca8cbebec748c7021c15dc078f747"}
May 26 16:08:10.593283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:10.593238    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-8hpz7" podStartSLOduration=1.885520573 podStartE2EDuration="6.593223343s" podCreationTimestamp="2026-05-26 16:08:04 +0000 UTC" firstStartedPulling="2026-05-26 16:08:05.360988287 +0000 UTC m=+446.883570310" lastFinishedPulling="2026-05-26 16:08:10.068691056 +0000 UTC m=+451.591273080" observedRunningTime="2026-05-26 16:08:10.592983009 +0000 UTC m=+452.115565053" watchObservedRunningTime="2026-05-26 16:08:10.593223343 +0000 UTC m=+452.115805387"
May 26 16:08:13.577283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:13.577250    2547 generic.go:358] "Generic (PLEG): container finished" podID="fe6effb7-5fd5-4173-9643-2736e6790219" containerID="f2e87f05ddc60af902b43ddda6f5d5774acca8cbebec748c7021c15dc078f747" exitCode=0
May 26 16:08:13.577283 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:13.577287    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8hpz7" event={"ID":"fe6effb7-5fd5-4173-9643-2736e6790219","Type":"ContainerDied","Data":"f2e87f05ddc60af902b43ddda6f5d5774acca8cbebec748c7021c15dc078f747"}
May 26 16:08:14.707986 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:14.707964    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8hpz7"
May 26 16:08:14.807014 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:14.806983    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2l85\" (UniqueName: \"kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85\") pod \"fe6effb7-5fd5-4173-9643-2736e6790219\" (UID: \"fe6effb7-5fd5-4173-9643-2736e6790219\") "
May 26 16:08:14.809166 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:14.809138    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85" (OuterVolumeSpecName: "kube-api-access-x2l85") pod "fe6effb7-5fd5-4173-9643-2736e6790219" (UID: "fe6effb7-5fd5-4173-9643-2736e6790219"). InnerVolumeSpecName "kube-api-access-x2l85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:08:14.908472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:14.908390    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2l85\" (UniqueName: \"kubernetes.io/projected/fe6effb7-5fd5-4173-9643-2736e6790219-kube-api-access-x2l85\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:08:15.585127 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:15.585090    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8hpz7" event={"ID":"fe6effb7-5fd5-4173-9643-2736e6790219","Type":"ContainerDied","Data":"a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3"}
May 26 16:08:15.585127 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:15.585116    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8hpz7"
May 26 16:08:15.585127 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:15.585129    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8e156b38fcd4dbd10a2fcfdcc0ceffa29cadd7672d082ea823065304be60fa3"
May 26 16:08:48.671610 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.671574    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6844d594b-2rfd9"]
May 26 16:08:48.672106 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.671974    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6effb7-5fd5-4173-9643-2736e6790219" containerName="s3-init"
May 26 16:08:48.672106 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.671988    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6effb7-5fd5-4173-9643-2736e6790219" containerName="s3-init"
May 26 16:08:48.672106 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.672040    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe6effb7-5fd5-4173-9643-2736e6790219" containerName="s3-init"
May 26 16:08:48.703720 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.703691    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6844d594b-2rfd9"]
May 26 16:08:48.703899 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.703814    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.706027 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.705974    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 16:08:48.706172 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.705974    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 16:08:48.706225 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.706204    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 16:08:48.706421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.706402    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 16:08:48.706469 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.706421    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tf8sq\""
May 26 16:08:48.706517 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.706403    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 16:08:48.710823 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.710766    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 16:08:48.792265 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-oauth-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792272    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-trusted-ca-bundle\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792367    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792392    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fp6d\" (UniqueName: \"kubernetes.io/projected/37a31e6e-a801-46af-95d5-80e9a08e95b6-kube-api-access-8fp6d\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792415    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-service-ca\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.792455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.792441    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-oauth-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893154 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893118    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-oauth-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893154 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893165    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893372 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893259    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-trusted-ca-bundle\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893414 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893366    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893414 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893398    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fp6d\" (UniqueName: \"kubernetes.io/projected/37a31e6e-a801-46af-95d5-80e9a08e95b6-kube-api-access-8fp6d\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893504 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893421    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-service-ca\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.893504 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.893455    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-oauth-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.894210 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.894178    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-oauth-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.894210 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.894202    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.894346 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.894182    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-service-ca\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.894346 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.894265    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a31e6e-a801-46af-95d5-80e9a08e95b6-trusted-ca-bundle\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.896127 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.896107    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-oauth-config\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.896326 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.896305    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37a31e6e-a801-46af-95d5-80e9a08e95b6-console-serving-cert\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:48.903302 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:48.903280    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fp6d\" (UniqueName: \"kubernetes.io/projected/37a31e6e-a801-46af-95d5-80e9a08e95b6-kube-api-access-8fp6d\") pod \"console-6844d594b-2rfd9\" (UID: \"37a31e6e-a801-46af-95d5-80e9a08e95b6\") " pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:49.013679 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:49.013588    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:49.146069 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:49.146037    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6844d594b-2rfd9"]
May 26 16:08:49.149110 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:08:49.149081    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a31e6e_a801_46af_95d5_80e9a08e95b6.slice/crio-d8f3e670c28e3c8fef70e06b051390a6b6681b5ca6456b0b8b0235727aa9bb87 WatchSource:0}: Error finding container d8f3e670c28e3c8fef70e06b051390a6b6681b5ca6456b0b8b0235727aa9bb87: Status 404 returned error can't find the container with id d8f3e670c28e3c8fef70e06b051390a6b6681b5ca6456b0b8b0235727aa9bb87
May 26 16:08:49.685079 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:49.685043    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6844d594b-2rfd9" event={"ID":"37a31e6e-a801-46af-95d5-80e9a08e95b6","Type":"ContainerStarted","Data":"cfd09c568be0c95d8e3c12db7845cc6b6ee5bfe62612f6bc689d42c8c267f2c8"}
May 26 16:08:49.685079 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:49.685081    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6844d594b-2rfd9" event={"ID":"37a31e6e-a801-46af-95d5-80e9a08e95b6","Type":"ContainerStarted","Data":"d8f3e670c28e3c8fef70e06b051390a6b6681b5ca6456b0b8b0235727aa9bb87"}
May 26 16:08:49.710478 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:49.710425    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6844d594b-2rfd9" podStartSLOduration=1.710409371 podStartE2EDuration="1.710409371s" podCreationTimestamp="2026-05-26 16:08:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:08:49.709169464 +0000 UTC m=+491.231751509" watchObservedRunningTime="2026-05-26 16:08:49.710409371 +0000 UTC m=+491.232991416"
May 26 16:08:59.014256 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:59.014214    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:59.014764 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:59.014301    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:59.019200 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:59.019171    2547 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:08:59.719963 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:08:59.719934    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6844d594b-2rfd9"
May 26 16:10:10.381960 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.381927    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:10:10.385514 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.385498    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.388726 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.388698    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 26 16:10:10.388860 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.388745    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 26 16:10:10.388968 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.388951    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\""
May 26 16:10:10.389048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.389030    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-5c32b-predictor-serving-cert\""
May 26 16:10:10.389254 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.389240    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-llsfr\""
May 26 16:10:10.407802 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.407776    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:10:10.486992 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.482719    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.486992 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.482785    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.486992 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.482827    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qn9k\" (UniqueName: \"kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.486992 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.482912    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.583706 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.583662    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qn9k\" (UniqueName: \"kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.583936 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.583724    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.583936 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.583915    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.584063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.583955    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.584127 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.584110    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.584522 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.584493    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.586374 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.586355    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.596890 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.596849    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qn9k\" (UniqueName: \"kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k\") pod \"isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.695946 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.695908    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:10.837063 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.837035    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:10:10.929955 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:10.929918    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerStarted","Data":"3d26688fd680707b8a938041792ce2347d11d805b90b03212167917b0ec0df55"}
May 26 16:10:14.944896 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:14.944775    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerStarted","Data":"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"}
May 26 16:10:18.957742 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:18.957706    2547 generic.go:358] "Generic (PLEG): container finished" podID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerID="f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895" exitCode=0
May 26 16:10:18.958170 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:18.957756    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerDied","Data":"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"}
May 26 16:10:39.024927 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:39.024896    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:10:39.025427 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:39.025028    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:10:39.026242 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:39.026217    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerStarted","Data":"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"}
May 26 16:10:42.038382 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:42.038341    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerStarted","Data":"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"}
May 26 16:10:42.038794 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:42.038447    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:42.069553 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:42.069497    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podStartSLOduration=1.340028658 podStartE2EDuration="32.069480505s" podCreationTimestamp="2026-05-26 16:10:10 +0000 UTC" firstStartedPulling="2026-05-26 16:10:10.843348575 +0000 UTC m=+572.365930598" lastFinishedPulling="2026-05-26 16:10:41.572800412 +0000 UTC m=+603.095382445" observedRunningTime="2026-05-26 16:10:42.067453864 +0000 UTC m=+603.590035909" watchObservedRunningTime="2026-05-26 16:10:42.069480505 +0000 UTC m=+603.592062550"
May 26 16:10:43.043161 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:43.043128    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:43.044520 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:43.044485    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:10:44.046054 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:44.046016    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:10:49.050532 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:49.050505    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:10:49.051099 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:49.051070    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:10:59.051247 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:10:59.051169    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:11:09.051830 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:09.051787    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:11:19.051919 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:19.051861    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:11:29.051044 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:29.051000    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
May 26 16:11:39.052010 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:39.051982    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:11:40.201860 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.201819    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:11:40.205355 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.205332    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.207208 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.207183    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5c32b-kube-rbac-proxy-sar-config\""
May 26 16:11:40.207365 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.207341    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5c32b-serving-cert\""
May 26 16:11:40.223499 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.223476    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:11:40.391837 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.391800    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.392058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.391857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.492623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.492540    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.492623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.492587    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.493218 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.493199    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.494962 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.494946    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls\") pod \"model-chainer-raw-5c32b-6759b7bc5d-tlhr6\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") " pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.515550 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.515520    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:40.645600 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:40.645572    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:11:40.648752 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:11:40.648726    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c680e5_fe60_43c0_ab43_61eff5761b4a.slice/crio-fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff WatchSource:0}: Error finding container fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff: Status 404 returned error can't find the container with id fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff
May 26 16:11:41.216269 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:41.216231    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" event={"ID":"52c680e5-fe60-43c0-ab43-61eff5761b4a","Type":"ContainerStarted","Data":"fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff"}
May 26 16:11:43.223301 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:43.223267    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" event={"ID":"52c680e5-fe60-43c0-ab43-61eff5761b4a","Type":"ContainerStarted","Data":"753328fe22b35cd8e73f4d3d6c918cbf6ad504c04311f0b3032dbdbb686711ca"}
May 26 16:11:43.223670 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:43.223386    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:43.244068 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:43.244023    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podStartSLOduration=0.828321081 podStartE2EDuration="3.244007343s" podCreationTimestamp="2026-05-26 16:11:40 +0000 UTC" firstStartedPulling="2026-05-26 16:11:40.650410067 +0000 UTC m=+662.172992089" lastFinishedPulling="2026-05-26 16:11:43.066096324 +0000 UTC m=+664.588678351" observedRunningTime="2026-05-26 16:11:43.242532048 +0000 UTC m=+664.765114094" watchObservedRunningTime="2026-05-26 16:11:43.244007343 +0000 UTC m=+664.766589389"
May 26 16:11:49.232648 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:49.232619    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:11:50.220361 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.220331    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:11:50.220549 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.220526    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" containerID="cri-o://753328fe22b35cd8e73f4d3d6c918cbf6ad504c04311f0b3032dbdbb686711ca" gracePeriod=30
May 26 16:11:50.416412 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.416381    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:11:50.416796 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.416741    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container" containerID="cri-o://7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b" gracePeriod=30
May 26 16:11:50.416863 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.416791    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kube-rbac-proxy" containerID="cri-o://5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86" gracePeriod=30
May 26 16:11:50.703649 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.703612    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:11:50.707410 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.707388    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.709371 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.709351    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\""
May 26 16:11:50.709371 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.709361    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-89f63-predictor-serving-cert\""
May 26 16:11:50.726406 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.726381    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:11:50.785729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.785648    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.785729 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.785687    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.785939 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.785745    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.785939 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.785769    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpg5q\" (UniqueName: \"kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887096 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887047    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887130    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpg5q\" (UniqueName: \"kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887213    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887264 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887240    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887371 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:11:50.887331    2547 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-serving-cert: secret "isvc-xgboost-graph-raw-hpa-89f63-predictor-serving-cert" not found
May 26 16:11:50.887405 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:11:50.887388    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls podName:3723d817-ba42-4581-8d77-1738ecf4b6ca nodeName:}" failed. No retries permitted until 2026-05-26 16:11:51.38737261 +0000 UTC m=+672.909954633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls") pod "isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" (UID: "3723d817-ba42-4581-8d77-1738ecf4b6ca") : secret "isvc-xgboost-graph-raw-hpa-89f63-predictor-serving-cert" not found
May 26 16:11:50.887589 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887564    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.887741 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.887709    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:50.899773 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:50.899748    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpg5q\" (UniqueName: \"kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:51.248443 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.248408    2547 generic.go:358] "Generic (PLEG): container finished" podID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerID="5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86" exitCode=2
May 26 16:11:51.248443 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.248444    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerDied","Data":"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"}
May 26 16:11:51.391940 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.391903    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:51.394367 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.394344    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:51.617312 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.617222    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:51.750212 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:51.750175    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:11:51.753478 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:11:51.753452    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3723d817_ba42_4581_8d77_1738ecf4b6ca.slice/crio-43b45597c6332c09728dcbd7efb74d660d3df169638747407a415202bf163c57 WatchSource:0}: Error finding container 43b45597c6332c09728dcbd7efb74d660d3df169638747407a415202bf163c57: Status 404 returned error can't find the container with id 43b45597c6332c09728dcbd7efb74d660d3df169638747407a415202bf163c57
May 26 16:11:52.253385 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:52.253351    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerStarted","Data":"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"}
May 26 16:11:52.253385 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:52.253386    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerStarted","Data":"43b45597c6332c09728dcbd7efb74d660d3df169638747407a415202bf163c57"}
May 26 16:11:54.046454 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.046413    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused"
May 26 16:11:54.155421 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.155398    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:11:54.215808 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.215727    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location\") pod \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") "
May 26 16:11:54.215808 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.215801    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qn9k\" (UniqueName: \"kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k\") pod \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") "
May 26 16:11:54.216052 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.215840    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls\") pod \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") "
May 26 16:11:54.216052 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.215900    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\") pod \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\" (UID: \"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e\") "
May 26 16:11:54.216157 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.216088    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" (UID: "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:11:54.216300 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.216278    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config") pod "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" (UID: "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e"). InnerVolumeSpecName "isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:54.218058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.218038    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" (UID: "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:11:54.218058 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.218042    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k" (OuterVolumeSpecName: "kube-api-access-5qn9k") pod "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" (UID: "a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e"). InnerVolumeSpecName "kube-api-access-5qn9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:11:54.230777 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.230747    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:11:54.261682 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.261655    2547 generic.go:358] "Generic (PLEG): container finished" podID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerID="7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b" exitCode=0
May 26 16:11:54.261797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.261723    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerDied","Data":"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"}
May 26 16:11:54.261797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.261750    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s" event={"ID":"a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e","Type":"ContainerDied","Data":"3d26688fd680707b8a938041792ce2347d11d805b90b03212167917b0ec0df55"}
May 26 16:11:54.261797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.261765    2547 scope.go:117] "RemoveContainer" containerID="5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"
May 26 16:11:54.261797 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.261766    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"
May 26 16:11:54.269706 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.269657    2547 scope.go:117] "RemoveContainer" containerID="7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"
May 26 16:11:54.276915 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.276895    2547 scope.go:117] "RemoveContainer" containerID="f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"
May 26 16:11:54.283472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.283455    2547 scope.go:117] "RemoveContainer" containerID="5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"
May 26 16:11:54.283708 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:11:54.283686    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86\": container with ID starting with 5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86 not found: ID does not exist" containerID="5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"
May 26 16:11:54.283758 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.283715    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86"} err="failed to get container status \"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86\": rpc error: code = NotFound desc = could not find container \"5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86\": container with ID starting with 5b6e57628f1a553fa5b137e4d743af4a8472ff2518a550eb04021fe23b0d0f86 not found: ID does not exist"
May 26 16:11:54.283758 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.283734    2547 scope.go:117] "RemoveContainer" containerID="7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"
May 26 16:11:54.283953 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:11:54.283932    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b\": container with ID starting with 7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b not found: ID does not exist" containerID="7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"
May 26 16:11:54.284026 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.283962    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b"} err="failed to get container status \"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b\": rpc error: code = NotFound desc = could not find container \"7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b\": container with ID starting with 7e6e5a1d22cc15ab2ad373b4fa3b5e9ffadd2db3df2d1e3b2ad508f74678957b not found: ID does not exist"
May 26 16:11:54.284026 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.283986    2547 scope.go:117] "RemoveContainer" containerID="f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"
May 26 16:11:54.284218 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:11:54.284200    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895\": container with ID starting with f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895 not found: ID does not exist" containerID="f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"
May 26 16:11:54.284261 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.284223    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895"} err="failed to get container status \"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895\": rpc error: code = NotFound desc = could not find container \"f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895\": container with ID starting with f3fb465170fa1bfecf88a33808ca0d0faab24c507d3bc6ad3290f0a068172895 not found: ID does not exist"
May 26 16:11:54.296617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.296597    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:11:54.304623 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.304605    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-5c32b-predictor-76bb944969-2785s"]
May 26 16:11:54.317049 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.317025    2547 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kserve-provision-location\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:11:54.317049 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.317049    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qn9k\" (UniqueName: \"kubernetes.io/projected/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-kube-api-access-5qn9k\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:11:54.317148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.317060    2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-proxy-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:11:54.317148 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:54.317069    2547 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e-isvc-xgboost-graph-raw-5c32b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:11:55.115548 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:55.115511    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" path="/var/lib/kubelet/pods/a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e/volumes"
May 26 16:11:56.270650 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:56.270620    2547 generic.go:358] "Generic (PLEG): container finished" podID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerID="013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6" exitCode=0
May 26 16:11:56.271034 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:56.270689    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerDied","Data":"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"}
May 26 16:11:57.275472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:57.275439    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerStarted","Data":"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"}
May 26 16:11:57.275472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:57.275475    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerStarted","Data":"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"}
May 26 16:11:57.275911 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:57.275672    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:57.303178 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:57.303129    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podStartSLOduration=7.303113918 podStartE2EDuration="7.303113918s" podCreationTimestamp="2026-05-26 16:11:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:11:57.301316898 +0000 UTC m=+678.823898944" watchObservedRunningTime="2026-05-26 16:11:57.303113918 +0000 UTC m=+678.825695963"
May 26 16:11:58.280975 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:58.280945    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:11:58.282077 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:58.282054    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:11:59.230977 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:59.230943    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:11:59.283783 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:11:59.283741    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:04.232457 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:04.232420    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:12:04.232917 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:04.232575    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:12:04.288637 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:04.288605    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:12:04.289095 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:04.289068    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:09.230831 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:09.230788    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:12:14.231269 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:14.231227    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:12:14.289675 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:14.289637    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:19.232176 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:19.232134    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:12:20.354444 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.354414    2547 generic.go:358] "Generic (PLEG): container finished" podID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerID="753328fe22b35cd8e73f4d3d6c918cbf6ad504c04311f0b3032dbdbb686711ca" exitCode=0
May 26 16:12:20.354763 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.354447    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" event={"ID":"52c680e5-fe60-43c0-ab43-61eff5761b4a","Type":"ContainerDied","Data":"753328fe22b35cd8e73f4d3d6c918cbf6ad504c04311f0b3032dbdbb686711ca"}
May 26 16:12:20.354763 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.354491    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6" event={"ID":"52c680e5-fe60-43c0-ab43-61eff5761b4a","Type":"ContainerDied","Data":"fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff"}
May 26 16:12:20.354763 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.354506    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc9d2c7beb91c4716da6812bca9228259ffb213f1e268999bd0164f01f0b89ff"
May 26 16:12:20.363270 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.363251    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:12:20.548648 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.548560    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle\") pod \"52c680e5-fe60-43c0-ab43-61eff5761b4a\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") "
May 26 16:12:20.548648 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.548640    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls\") pod \"52c680e5-fe60-43c0-ab43-61eff5761b4a\" (UID: \"52c680e5-fe60-43c0-ab43-61eff5761b4a\") "
May 26 16:12:20.548919 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.548899    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "52c680e5-fe60-43c0-ab43-61eff5761b4a" (UID: "52c680e5-fe60-43c0-ab43-61eff5761b4a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:12:20.550678 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.550654    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "52c680e5-fe60-43c0-ab43-61eff5761b4a" (UID: "52c680e5-fe60-43c0-ab43-61eff5761b4a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:12:20.649367 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.649339    2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/52c680e5-fe60-43c0-ab43-61eff5761b4a-proxy-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:12:20.649367 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:20.649367    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52c680e5-fe60-43c0-ab43-61eff5761b4a-openshift-service-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:12:21.357500 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:21.357464    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"
May 26 16:12:21.378601 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:21.378527    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:12:21.384213 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:21.384190    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5c32b-6759b7bc5d-tlhr6"]
May 26 16:12:23.114856 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:23.114779    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" path="/var/lib/kubelet/pods/52c680e5-fe60-43c0-ab43-61eff5761b4a/volumes"
May 26 16:12:24.289632 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:24.289589    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:34.289860 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:34.289821    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:44.290053 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:44.290008    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:12:54.290070 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:12:54.290024    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:13:04.290059 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:04.290021    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:13:20.563969 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.563932    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:13:20.564336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564308    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b"
May 26 16:13:20.564336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564319    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b"
May 26 16:13:20.564336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564328    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container"
May 26 16:13:20.564336 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564333    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564340    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kube-rbac-proxy"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564347    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kube-rbac-proxy"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564358    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="storage-initializer"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564366    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="storage-initializer"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564436    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kube-rbac-proxy"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564445    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="52c680e5-fe60-43c0-ab43-61eff5761b4a" containerName="model-chainer-raw-5c32b"
May 26 16:13:20.564460 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.564455    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="a35a2f26-8c15-4a9e-b47b-4496e1d8ed8e" containerName="kserve-container"
May 26 16:13:20.566272 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.566256    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.569305 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.569281    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-89f63-serving-cert\""
May 26 16:13:20.569906 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.569859    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-89f63-kube-rbac-proxy-sar-config\""
May 26 16:13:20.588546 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.588512    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:13:20.686290 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.686256    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.686470 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.686313    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.787678 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.787645    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.787838 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.787693    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.788428 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.788409    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.790029 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.790013    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls\") pod \"model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:20.876587 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:20.876507    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:21.004668 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.004633    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:13:21.007348 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:13:21.007319    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493decd_7537_40b4_8f04_247dd339dfac.slice/crio-a63ada666e8ffca15127a43abaa6e30a4aee31d7cb81968df5ac1db7788fe6d7 WatchSource:0}: Error finding container a63ada666e8ffca15127a43abaa6e30a4aee31d7cb81968df5ac1db7788fe6d7: Status 404 returned error can't find the container with id a63ada666e8ffca15127a43abaa6e30a4aee31d7cb81968df5ac1db7788fe6d7
May 26 16:13:21.009169 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.009149    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:13:21.537753 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.537717    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" event={"ID":"7493decd-7537-40b4-8f04-247dd339dfac","Type":"ContainerStarted","Data":"b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1"}
May 26 16:13:21.537753 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.537756    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" event={"ID":"7493decd-7537-40b4-8f04-247dd339dfac","Type":"ContainerStarted","Data":"a63ada666e8ffca15127a43abaa6e30a4aee31d7cb81968df5ac1db7788fe6d7"}
May 26 16:13:21.538027 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.537824    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:21.556491 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:21.556437    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podStartSLOduration=1.556421057 podStartE2EDuration="1.556421057s" podCreationTimestamp="2026-05-26 16:13:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:13:21.555551685 +0000 UTC m=+763.078133730" watchObservedRunningTime="2026-05-26 16:13:21.556421057 +0000 UTC m=+763.079003102"
May 26 16:13:27.545924 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:27.545897    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:30.619061 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:30.619029    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:13:30.619433 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:30.619266    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" containerID="cri-o://b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1" gracePeriod=30
May 26 16:13:30.868446 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:30.868415    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:13:30.868742 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:30.868718    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" containerID="cri-o://a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7" gracePeriod=30
May 26 16:13:30.868813 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:30.868755    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kube-rbac-proxy" containerID="cri-o://7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf" gracePeriod=30
May 26 16:13:31.576018 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:31.575984    2547 generic.go:358] "Generic (PLEG): container finished" podID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerID="7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf" exitCode=2
May 26 16:13:31.576189 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:31.576030    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerDied","Data":"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"}
May 26 16:13:32.544752 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:32.544705    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:13:34.284661 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.284633    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
May 26 16:13:34.290110 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.290077    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
May 26 16:13:34.402451 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.402429    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:13:34.514935 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.514848    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpg5q\" (UniqueName: \"kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q\") pod \"3723d817-ba42-4581-8d77-1738ecf4b6ca\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") "
May 26 16:13:34.514935 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.514931    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\") pod \"3723d817-ba42-4581-8d77-1738ecf4b6ca\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") "
May 26 16:13:34.515116 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.514980    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location\") pod \"3723d817-ba42-4581-8d77-1738ecf4b6ca\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") "
May 26 16:13:34.515116 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.514996    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") pod \"3723d817-ba42-4581-8d77-1738ecf4b6ca\" (UID: \"3723d817-ba42-4581-8d77-1738ecf4b6ca\") "
May 26 16:13:34.515305 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.515276    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3723d817-ba42-4581-8d77-1738ecf4b6ca" (UID: "3723d817-ba42-4581-8d77-1738ecf4b6ca"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:13:34.515416 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.515345    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config") pod "3723d817-ba42-4581-8d77-1738ecf4b6ca" (UID: "3723d817-ba42-4581-8d77-1738ecf4b6ca"). InnerVolumeSpecName "isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:13:34.516987 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.516963    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q" (OuterVolumeSpecName: "kube-api-access-zpg5q") pod "3723d817-ba42-4581-8d77-1738ecf4b6ca" (UID: "3723d817-ba42-4581-8d77-1738ecf4b6ca"). InnerVolumeSpecName "kube-api-access-zpg5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:13:34.517048 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.516997    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3723d817-ba42-4581-8d77-1738ecf4b6ca" (UID: "3723d817-ba42-4581-8d77-1738ecf4b6ca"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:13:34.587434 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.587397    2547 generic.go:358] "Generic (PLEG): container finished" podID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerID="a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7" exitCode=0
May 26 16:13:34.587595 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.587450    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerDied","Data":"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"}
May 26 16:13:34.587595 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.587473    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"
May 26 16:13:34.587595 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.587486    2547 scope.go:117] "RemoveContainer" containerID="7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"
May 26 16:13:34.587727 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.587476    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24" event={"ID":"3723d817-ba42-4581-8d77-1738ecf4b6ca","Type":"ContainerDied","Data":"43b45597c6332c09728dcbd7efb74d660d3df169638747407a415202bf163c57"}
May 26 16:13:34.596160 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.596144    2547 scope.go:117] "RemoveContainer" containerID="a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"
May 26 16:13:34.602993 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.602976    2547 scope.go:117] "RemoveContainer" containerID="013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"
May 26 16:13:34.610115 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610093    2547 scope.go:117] "RemoveContainer" containerID="7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"
May 26 16:13:34.610393 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:13:34.610369    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf\": container with ID starting with 7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf not found: ID does not exist" containerID="7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"
May 26 16:13:34.610472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610408    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf"} err="failed to get container status \"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf\": rpc error: code = NotFound desc = could not find container \"7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf\": container with ID starting with 7f8c648b444da60ba22ba9af951a7c978caab37d46780d3a8a27ec438fa13aaf not found: ID does not exist"
May 26 16:13:34.610472 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610435    2547 scope.go:117] "RemoveContainer" containerID="a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"
May 26 16:13:34.610686 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:13:34.610663    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7\": container with ID starting with a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7 not found: ID does not exist" containerID="a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"
May 26 16:13:34.610727 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610697    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7"} err="failed to get container status \"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7\": rpc error: code = NotFound desc = could not find container \"a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7\": container with ID starting with a40bd6f1be20b31220c569e2546432af6dcd07ce7956735f785ee65def98a8f7 not found: ID does not exist"
May 26 16:13:34.610727 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610719    2547 scope.go:117] "RemoveContainer" containerID="013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"
May 26 16:13:34.610974 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:13:34.610951    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6\": container with ID starting with 013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6 not found: ID does not exist" containerID="013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"
May 26 16:13:34.611025 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.610983    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6"} err="failed to get container status \"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6\": rpc error: code = NotFound desc = could not find container \"013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6\": container with ID starting with 013fe41258019ce82ae6d78f9abe90015b6f50e064579b9e1360179d1dcf8ef6 not found: ID does not exist"
May 26 16:13:34.611306 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.611292    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:13:34.615770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.615708    2547 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3723d817-ba42-4581-8d77-1738ecf4b6ca-kserve-provision-location\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:13:34.615770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.615733    2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3723d817-ba42-4581-8d77-1738ecf4b6ca-proxy-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:13:34.615770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.615750    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpg5q\" (UniqueName: \"kubernetes.io/projected/3723d817-ba42-4581-8d77-1738ecf4b6ca-kube-api-access-zpg5q\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:13:34.615770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.615765    2547 reconciler_common.go:299] "Volume detached for volume \"isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3723d817-ba42-4581-8d77-1738ecf4b6ca-isvc-xgboost-graph-raw-hpa-89f63-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:13:34.617751 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:34.617734    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-89f63-predictor-747dddcbf-rxj24"]
May 26 16:13:35.115221 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:35.115188    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" path="/var/lib/kubelet/pods/3723d817-ba42-4581-8d77-1738ecf4b6ca/volumes"
May 26 16:13:37.544764 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:37.544726    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:13:42.545015 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:42.544972    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:13:42.545366 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:42.545089    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:13:47.544538 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:47.544500    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:13:52.545219 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:52.545182    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:13:57.545370 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:13:57.545279    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:14:00.648216 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:14:00.648181    2547 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493decd_7537_40b4_8f04_247dd339dfac.slice/crio-b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493decd_7537_40b4_8f04_247dd339dfac.slice/crio-conmon-b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1.scope\": RecentStats: unable to find data in memory cache]"
May 26 16:14:00.648651 ip-10-0-137-117 kubenswrapper[2547]: E0526 16:14:00.648251    2547 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493decd_7537_40b4_8f04_247dd339dfac.slice/crio-conmon-b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7493decd_7537_40b4_8f04_247dd339dfac.slice/crio-b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1.scope\": RecentStats: unable to find data in memory cache]"
May 26 16:14:00.668437 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.668404    2547 generic.go:358] "Generic (PLEG): container finished" podID="7493decd-7537-40b4-8f04-247dd339dfac" containerID="b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1" exitCode=0
May 26 16:14:00.668620 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.668479    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" event={"ID":"7493decd-7537-40b4-8f04-247dd339dfac","Type":"ContainerDied","Data":"b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1"}
May 26 16:14:00.774054 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.774030    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:14:00.839511 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.839478    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls\") pod \"7493decd-7537-40b4-8f04-247dd339dfac\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") "
May 26 16:14:00.839511 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.839513    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle\") pod \"7493decd-7537-40b4-8f04-247dd339dfac\" (UID: \"7493decd-7537-40b4-8f04-247dd339dfac\") "
May 26 16:14:00.839966 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.839940    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7493decd-7537-40b4-8f04-247dd339dfac" (UID: "7493decd-7537-40b4-8f04-247dd339dfac"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:14:00.841537 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.841514    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7493decd-7537-40b4-8f04-247dd339dfac" (UID: "7493decd-7537-40b4-8f04-247dd339dfac"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:14:00.941067 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.941026    2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7493decd-7537-40b4-8f04-247dd339dfac-proxy-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:14:00.941067 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:00.941066    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7493decd-7537-40b4-8f04-247dd339dfac-openshift-service-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:14:01.672929 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:01.672863    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh" event={"ID":"7493decd-7537-40b4-8f04-247dd339dfac","Type":"ContainerDied","Data":"a63ada666e8ffca15127a43abaa6e30a4aee31d7cb81968df5ac1db7788fe6d7"}
May 26 16:14:01.672929 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:01.672938    2547 scope.go:117] "RemoveContainer" containerID="b154eec6608ffd0b82593e0e2dea5a10b7a689b84c3b42c0a4487cb451b5d6b1"
May 26 16:14:01.673425 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:01.672945    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"
May 26 16:14:01.690247 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:01.690217    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:14:01.695037 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:01.695005    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-89f63-58f5997b9d-q9zwh"]
May 26 16:14:03.114853 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:14:03.114821    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7493decd-7537-40b4-8f04-247dd339dfac" path="/var/lib/kubelet/pods/7493decd-7537-40b4-8f04-247dd339dfac/volumes"
May 26 16:15:39.048017 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:15:39.047991    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:15:39.049931 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:15:39.049862    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:18:39.087803 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:18:39.087771    2547 scope.go:117] "RemoveContainer" containerID="753328fe22b35cd8e73f4d3d6c918cbf6ad504c04311f0b3032dbdbb686711ca"
May 26 16:20:39.070449 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:20:39.070417    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:20:39.076129 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:20:39.076105    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:22:06.871397 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871365    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljzb4/must-gather-lt7gc"]
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871685    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="storage-initializer"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871696    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="storage-initializer"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871708    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871714    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871734    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kube-rbac-proxy"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871739    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kube-rbac-proxy"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871751    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871757    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871808    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kube-rbac-proxy"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871817    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="3723d817-ba42-4581-8d77-1738ecf4b6ca" containerName="kserve-container"
May 26 16:22:06.871867 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.871822    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="7493decd-7537-40b4-8f04-247dd339dfac" containerName="model-chainer-raw-hpa-89f63"
May 26 16:22:06.875011 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.874991    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:06.877293 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.877270    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljzb4\"/\"openshift-service-ca.crt\""
May 26 16:22:06.877764 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.877740    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljzb4\"/\"default-dockercfg-5kqmk\""
May 26 16:22:06.877764 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.877752    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljzb4\"/\"kube-root-ca.crt\""
May 26 16:22:06.882290 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.882265    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljzb4/must-gather-lt7gc"]
May 26 16:22:06.980795 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.980741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nsrh\" (UniqueName: \"kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:06.980795 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:06.980795    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.081984 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.081947    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nsrh\" (UniqueName: \"kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.082104 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.081991    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.082307 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.082292    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.091354 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.091325    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nsrh\" (UniqueName: \"kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh\") pod \"must-gather-lt7gc\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") " pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.193258 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.193228    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:07.320659 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.320623    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljzb4/must-gather-lt7gc"]
May 26 16:22:07.323590 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:22:07.323565    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bb734c8_cfe0_43b3_a559_3f68fbb95b9d.slice/crio-499f6abc5ac79e3d76fcd1fa3bad2a63b11c40d93d3acd45a9a3f5a2b8d6efe1 WatchSource:0}: Error finding container 499f6abc5ac79e3d76fcd1fa3bad2a63b11c40d93d3acd45a9a3f5a2b8d6efe1: Status 404 returned error can't find the container with id 499f6abc5ac79e3d76fcd1fa3bad2a63b11c40d93d3acd45a9a3f5a2b8d6efe1
May 26 16:22:07.325359 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:07.325340    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:22:08.109065 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:08.109027    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" event={"ID":"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d","Type":"ContainerStarted","Data":"499f6abc5ac79e3d76fcd1fa3bad2a63b11c40d93d3acd45a9a3f5a2b8d6efe1"}
May 26 16:22:14.134169 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:14.134130    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" event={"ID":"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d","Type":"ContainerStarted","Data":"45b65197ce4fceab2504da023291e5c46b095c27aaf34c9ecc0d17bacff72a33"}
May 26 16:22:14.134566 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:14.134176    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" event={"ID":"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d","Type":"ContainerStarted","Data":"62783f3e79fe747bb0489529bbb91408add47b34afed8f6655de1389c4854ecf"}
May 26 16:22:14.161455 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:14.161400    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" podStartSLOduration=2.054470752 podStartE2EDuration="8.16138492s" podCreationTimestamp="2026-05-26 16:22:06 +0000 UTC" firstStartedPulling="2026-05-26 16:22:07.32547526 +0000 UTC m=+1288.848057283" lastFinishedPulling="2026-05-26 16:22:13.432389417 +0000 UTC m=+1294.954971451" observedRunningTime="2026-05-26 16:22:14.159953262 +0000 UTC m=+1295.682535308" watchObservedRunningTime="2026-05-26 16:22:14.16138492 +0000 UTC m=+1295.683966965"
May 26 16:22:36.210672 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:36.210635    2547 generic.go:358] "Generic (PLEG): container finished" podID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerID="62783f3e79fe747bb0489529bbb91408add47b34afed8f6655de1389c4854ecf" exitCode=0
May 26 16:22:36.211118 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:36.210707    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" event={"ID":"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d","Type":"ContainerDied","Data":"62783f3e79fe747bb0489529bbb91408add47b34afed8f6655de1389c4854ecf"}
May 26 16:22:36.211118 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:36.211065    2547 scope.go:117] "RemoveContainer" containerID="62783f3e79fe747bb0489529bbb91408add47b34afed8f6655de1389c4854ecf"
May 26 16:22:36.273929 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:36.273899    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljzb4_must-gather-lt7gc_1bb734c8-cfe0-43b3-a559-3f68fbb95b9d/gather/0.log"
May 26 16:22:37.131784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.131755    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mvc8/must-gather-gznsw"]
May 26 16:22:37.134061 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.134043    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.137554 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.137524    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mvc8\"/\"openshift-service-ca.crt\""
May 26 16:22:37.138024 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.138002    2547 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mvc8\"/\"default-dockercfg-rbnlh\""
May 26 16:22:37.138024 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.138018    2547 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mvc8\"/\"kube-root-ca.crt\""
May 26 16:22:37.168541 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.168512    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mvc8/must-gather-gznsw"]
May 26 16:22:37.258688 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.258647    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2162fc4b-9ab3-4647-bcff-6539e2783a86-must-gather-output\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.259111 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.258720    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52fqc\" (UniqueName: \"kubernetes.io/projected/2162fc4b-9ab3-4647-bcff-6539e2783a86-kube-api-access-52fqc\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.360059 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.360025    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2162fc4b-9ab3-4647-bcff-6539e2783a86-must-gather-output\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.360230 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.360076    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52fqc\" (UniqueName: \"kubernetes.io/projected/2162fc4b-9ab3-4647-bcff-6539e2783a86-kube-api-access-52fqc\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.360374 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.360356    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2162fc4b-9ab3-4647-bcff-6539e2783a86-must-gather-output\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.379216 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.379192    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52fqc\" (UniqueName: \"kubernetes.io/projected/2162fc4b-9ab3-4647-bcff-6539e2783a86-kube-api-access-52fqc\") pod \"must-gather-gznsw\" (UID: \"2162fc4b-9ab3-4647-bcff-6539e2783a86\") " pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.443087 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.443048    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mvc8/must-gather-gznsw"
May 26 16:22:37.586685 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:37.586656    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mvc8/must-gather-gznsw"]
May 26 16:22:37.591284 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:22:37.591250    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2162fc4b_9ab3_4647_bcff_6539e2783a86.slice/crio-3eeae57f32854cee7f28ecd16942cf0915ea51550ae8f7c9319384b31246d471 WatchSource:0}: Error finding container 3eeae57f32854cee7f28ecd16942cf0915ea51550ae8f7c9319384b31246d471: Status 404 returned error can't find the container with id 3eeae57f32854cee7f28ecd16942cf0915ea51550ae8f7c9319384b31246d471
May 26 16:22:38.217268 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:38.217228    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mvc8/must-gather-gznsw" event={"ID":"2162fc4b-9ab3-4647-bcff-6539e2783a86","Type":"ContainerStarted","Data":"3eeae57f32854cee7f28ecd16942cf0915ea51550ae8f7c9319384b31246d471"}
May 26 16:22:39.224439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:39.224398    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mvc8/must-gather-gznsw" event={"ID":"2162fc4b-9ab3-4647-bcff-6539e2783a86","Type":"ContainerStarted","Data":"c985cf4aa03c8a70aafb4e4e0811f3ead931a01cd5ce9b3ae843d186679a3c4e"}
May 26 16:22:39.224439 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:39.224443    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mvc8/must-gather-gznsw" event={"ID":"2162fc4b-9ab3-4647-bcff-6539e2783a86","Type":"ContainerStarted","Data":"abbd8589dca8f3e7b2733247a43d06dd9dc45eb397d7dd6c5cddd4197fe594ca"}
May 26 16:22:40.192641 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:40.192609    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9dvk5_8623ad55-8f86-4a13-8245-c406043e60f7/global-pull-secret-syncer/0.log"
May 26 16:22:40.603289 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:40.603207    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8qslp_8c76d123-bcd8-44b8-a985-af7f30cc6c50/konnectivity-agent/0.log"
May 26 16:22:40.900345 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:40.900272    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-117.ec2.internal_526f86543568486463bfd1c4f84c7011/haproxy/0.log"
May 26 16:22:41.930146 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:41.930061    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8mvc8/must-gather-gznsw" podStartSLOduration=4.082608251 podStartE2EDuration="4.930023922s" podCreationTimestamp="2026-05-26 16:22:37 +0000 UTC" firstStartedPulling="2026-05-26 16:22:37.593153622 +0000 UTC m=+1319.115735644" lastFinishedPulling="2026-05-26 16:22:38.440569289 +0000 UTC m=+1319.963151315" observedRunningTime="2026-05-26 16:22:39.242015413 +0000 UTC m=+1320.764597458" watchObservedRunningTime="2026-05-26 16:22:41.930023922 +0000 UTC m=+1323.452605968"
May 26 16:22:41.931804 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:41.931775    2547 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ljzb4/must-gather-lt7gc"]
May 26 16:22:41.932169 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:41.932132    2547 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="copy" containerID="cri-o://45b65197ce4fceab2504da023291e5c46b095c27aaf34c9ecc0d17bacff72a33" gracePeriod=2
May 26 16:22:41.939533 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:41.938610    2547 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ljzb4/must-gather-lt7gc"]
May 26 16:22:42.238940 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.236687    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljzb4_must-gather-lt7gc_1bb734c8-cfe0-43b3-a559-3f68fbb95b9d/copy/0.log"
May 26 16:22:42.238940 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.237120    2547 generic.go:358] "Generic (PLEG): container finished" podID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerID="45b65197ce4fceab2504da023291e5c46b095c27aaf34c9ecc0d17bacff72a33" exitCode=143
May 26 16:22:42.326236 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.326156    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljzb4_must-gather-lt7gc_1bb734c8-cfe0-43b3-a559-3f68fbb95b9d/copy/0.log"
May 26 16:22:42.327093 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.326809    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:42.329463 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.329426    2547 status_manager.go:895] "Failed to get status for pod" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" pod="openshift-must-gather-ljzb4/must-gather-lt7gc" err="pods \"must-gather-lt7gc\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ljzb4\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object"
May 26 16:22:42.413191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.412573    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output\") pod \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") "
May 26 16:22:42.413191 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.412646    2547 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nsrh\" (UniqueName: \"kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh\") pod \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\" (UID: \"1bb734c8-cfe0-43b3-a559-3f68fbb95b9d\") "
May 26 16:22:42.415330 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.415303    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" (UID: "1bb734c8-cfe0-43b3-a559-3f68fbb95b9d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:22:42.416724 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.416671    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh" (OuterVolumeSpecName: "kube-api-access-9nsrh") pod "1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" (UID: "1bb734c8-cfe0-43b3-a559-3f68fbb95b9d"). InnerVolumeSpecName "kube-api-access-9nsrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:22:42.513795 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.513685    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nsrh\" (UniqueName: \"kubernetes.io/projected/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-kube-api-access-9nsrh\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:22:42.513795 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:42.513722    2547 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d-must-gather-output\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
May 26 16:22:43.117430 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.117391    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" path="/var/lib/kubelet/pods/1bb734c8-cfe0-43b3-a559-3f68fbb95b9d/volumes"
May 26 16:22:43.242772 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.242702    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljzb4_must-gather-lt7gc_1bb734c8-cfe0-43b3-a559-3f68fbb95b9d/copy/0.log"
May 26 16:22:43.243419 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.243398    2547 scope.go:117] "RemoveContainer" containerID="45b65197ce4fceab2504da023291e5c46b095c27aaf34c9ecc0d17bacff72a33"
May 26 16:22:43.243727 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.243708    2547 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljzb4/must-gather-lt7gc"
May 26 16:22:43.258318 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.258206    2547 scope.go:117] "RemoveContainer" containerID="62783f3e79fe747bb0489529bbb91408add47b34afed8f6655de1389c4854ecf"
May 26 16:22:43.837795 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.837636    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/alertmanager/0.log"
May 26 16:22:43.873769 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.873698    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/config-reloader/0.log"
May 26 16:22:43.907138 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.907009    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/kube-rbac-proxy-web/0.log"
May 26 16:22:43.942129 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.942100    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/kube-rbac-proxy/0.log"
May 26 16:22:43.981706 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:43.981675    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/kube-rbac-proxy-metric/0.log"
May 26 16:22:44.010344 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.010301    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/prom-label-proxy/0.log"
May 26 16:22:44.043158 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.043134    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b0e412f-32d8-45b5-aa23-01911bf6c221/init-config-reloader/0.log"
May 26 16:22:44.210415 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.210307    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-p27nj_890f8c25-22e6-4af0-9dae-efcdb7ea623a/kube-state-metrics/0.log"
May 26 16:22:44.249980 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.249921    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-p27nj_890f8c25-22e6-4af0-9dae-efcdb7ea623a/kube-rbac-proxy-main/0.log"
May 26 16:22:44.290446 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.290416    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-p27nj_890f8c25-22e6-4af0-9dae-efcdb7ea623a/kube-rbac-proxy-self/0.log"
May 26 16:22:44.328861 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.328827    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-648946bdf6-bxmkd_9f495979-8319-4913-beb5-f17786d7f4cc/metrics-server/0.log"
May 26 16:22:44.409684 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.409658    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fnss_d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0/node-exporter/0.log"
May 26 16:22:44.442752 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.442719    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fnss_d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0/kube-rbac-proxy/0.log"
May 26 16:22:44.478985 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.478901    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fnss_d841e34e-1d0a-4155-bbf2-3a1ddf6e75a0/init-textfile/0.log"
May 26 16:22:44.752677 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.752604    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wmkx9_52eb65d4-a61e-445b-8cff-585861b13b58/kube-rbac-proxy-main/0.log"
May 26 16:22:44.788107 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.788083    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wmkx9_52eb65d4-a61e-445b-8cff-585861b13b58/kube-rbac-proxy-self/0.log"
May 26 16:22:44.822723 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.822689    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-wmkx9_52eb65d4-a61e-445b-8cff-585861b13b58/openshift-state-metrics/0.log"
May 26 16:22:44.877988 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.877863    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/prometheus/0.log"
May 26 16:22:44.918044 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.918014    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/config-reloader/0.log"
May 26 16:22:44.967047 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:44.967019    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/thanos-sidecar/0.log"
May 26 16:22:45.033135 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.033024    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/kube-rbac-proxy-web/0.log"
May 26 16:22:45.088524 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.088499    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/kube-rbac-proxy/0.log"
May 26 16:22:45.125124 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.125098    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/kube-rbac-proxy-thanos/0.log"
May 26 16:22:45.166681 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.166655    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9f92ad8-051f-455c-b3a5-7fecbb754a55/init-config-reloader/0.log"
May 26 16:22:45.210419 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.210392    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-c5pdz_22ef5923-52ab-4994-b69d-4c5271aecd3c/prometheus-operator/0.log"
May 26 16:22:45.243507 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.243437    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-c5pdz_22ef5923-52ab-4994-b69d-4c5271aecd3c/kube-rbac-proxy/0.log"
May 26 16:22:45.288030 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.287953    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-9jch4_2e615563-9e82-4247-988e-a4a3609de933/prometheus-operator-admission-webhook/0.log"
May 26 16:22:45.482096 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.482047    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/thanos-query/0.log"
May 26 16:22:45.540951 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.540822    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/kube-rbac-proxy-web/0.log"
May 26 16:22:45.598670 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.598638    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/kube-rbac-proxy/0.log"
May 26 16:22:45.638130 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.638097    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/prom-label-proxy/0.log"
May 26 16:22:45.679509 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.679476    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/kube-rbac-proxy-rules/0.log"
May 26 16:22:45.717641 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:45.717618    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b848f74b-llhdr_84041378-321e-4f57-92fc-eb0116bb1313/kube-rbac-proxy-metrics/0.log"
May 26 16:22:47.164789 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.164759    2547 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"]
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165145    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="gather"
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165157    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="gather"
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165166    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="copy"
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165171    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="copy"
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165222    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="gather"
May 26 16:22:47.165253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.165233    2547 memory_manager.go:356] "RemoveStaleState removing state" podUID="1bb734c8-cfe0-43b3-a559-3f68fbb95b9d" containerName="copy"
May 26 16:22:47.170924 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.170899    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.181002 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.180976    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"]
May 26 16:22:47.259405 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.259369    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-proc\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.259598 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.259463    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-podres\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.259672 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.259629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-sys\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.260221 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.260185    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxcv\" (UniqueName: \"kubernetes.io/projected/1cb43da4-1d36-4f32-809f-79787f485b52-kube-api-access-4bxcv\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.260328 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.260233    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-lib-modules\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361608 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361569    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-sys\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361635    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxcv\" (UniqueName: \"kubernetes.io/projected/1cb43da4-1d36-4f32-809f-79787f485b52-kube-api-access-4bxcv\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361665    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-lib-modules\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361703    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-sys\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361711    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-proc\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361752    2547 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-podres\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.361784 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361769    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-proc\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.362013 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-podres\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.362013 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.361888    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cb43da4-1d36-4f32-809f-79787f485b52-lib-modules\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.375132 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.375101    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxcv\" (UniqueName: \"kubernetes.io/projected/1cb43da4-1d36-4f32-809f-79787f485b52-kube-api-access-4bxcv\") pod \"perf-node-gather-daemonset-zblsh\" (UID: \"1cb43da4-1d36-4f32-809f-79787f485b52\") " pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.483718 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.483673    2547 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:47.636137 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.636104    2547 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"]
May 26 16:22:47.641910 ip-10-0-137-117 kubenswrapper[2547]: W0526 16:22:47.639909    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1cb43da4_1d36_4f32_809f_79787f485b52.slice/crio-a918eb4e5fff5224e7640b7db18344ed843d15c56a69809d0c53b6ea9e94de9b WatchSource:0}: Error finding container a918eb4e5fff5224e7640b7db18344ed843d15c56a69809d0c53b6ea9e94de9b: Status 404 returned error can't find the container with id a918eb4e5fff5224e7640b7db18344ed843d15c56a69809d0c53b6ea9e94de9b
May 26 16:22:47.734770 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.734683    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6844d594b-2rfd9_37a31e6e-a801-46af-95d5-80e9a08e95b6/console/0.log"
May 26 16:22:47.772757 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:47.772716    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-wvfpf_a357b4a5-225d-4366-92f3-6a017caa1257/download-server/0.log"
May 26 16:22:48.267253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:48.267209    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh" event={"ID":"1cb43da4-1d36-4f32-809f-79787f485b52","Type":"ContainerStarted","Data":"43a2bd984c912f0311592be8cb4ad136e43c0ab71e3f3fb985863bf455a41fad"}
May 26 16:22:48.267253 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:48.267261    2547 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh" event={"ID":"1cb43da4-1d36-4f32-809f-79787f485b52","Type":"ContainerStarted","Data":"a918eb4e5fff5224e7640b7db18344ed843d15c56a69809d0c53b6ea9e94de9b"}
May 26 16:22:48.267815 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:48.267453    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:48.286675 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:48.286625    2547 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh" podStartSLOduration=1.286606822 podStartE2EDuration="1.286606822s" podCreationTimestamp="2026-05-26 16:22:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:22:48.285665602 +0000 UTC m=+1329.808247648" watchObservedRunningTime="2026-05-26 16:22:48.286606822 +0000 UTC m=+1329.809188869"
May 26 16:22:48.976598 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:48.976561    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5dnjd_e5a79bf9-89c4-43ed-ac2e-440b69c78a55/dns/0.log"
May 26 16:22:49.004584 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:49.004554    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5dnjd_e5a79bf9-89c4-43ed-ac2e-440b69c78a55/kube-rbac-proxy/0.log"
May 26 16:22:49.179354 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:49.179328    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmwfd_b5efca32-5502-461c-9577-6b8aeb2d5c63/dns-node-resolver/0.log"
May 26 16:22:49.876267 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:49.876232    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htshq_e8bdc443-ee58-47ed-a2df-8eddd26fe32f/node-ca/0.log"
May 26 16:22:51.211431 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:51.211397    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zq4hz_1d6f4d6d-9768-4aab-af64-9afc90e04eb5/serve-healthcheck-canary/0.log"
May 26 16:22:51.786979 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:51.786950    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv5v2_89110749-1546-4744-86e5-155487643e8d/kube-rbac-proxy/0.log"
May 26 16:22:51.829017 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:51.828979    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv5v2_89110749-1546-4744-86e5-155487643e8d/exporter/0.log"
May 26 16:22:51.869540 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:51.869499    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv5v2_89110749-1546-4744-86e5-155487643e8d/extractor/0.log"
May 26 16:22:54.112646 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:54.112568    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6f7545b5b9-mj45m_47a2bbd7-70d1-429b-b9f8-686914bd0ed4/manager/0.log"
May 26 16:22:54.281568 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:54.281541    2547 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mvc8/perf-node-gather-daemonset-zblsh"
May 26 16:22:54.366581 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:22:54.366503    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8hpz7_fe6effb7-5fd5-4173-9643-2736e6790219/s3-init/0.log"
May 26 16:23:00.868896 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:00.868845    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9vnsh_7a00d1bc-bb23-485a-bf5b-f3f4dac07285/kube-multus/0.log"
May 26 16:23:01.467123 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.467093    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/kube-multus-additional-cni-plugins/0.log"
May 26 16:23:01.510708 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.510674    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/egress-router-binary-copy/0.log"
May 26 16:23:01.548749 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.548717    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/cni-plugins/0.log"
May 26 16:23:01.583979 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.583947    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/bond-cni-plugin/0.log"
May 26 16:23:01.623374 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.623344    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/routeoverride-cni/0.log"
May 26 16:23:01.680749 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.680721    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/whereabouts-cni-bincopy/0.log"
May 26 16:23:01.750594 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.750510    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd95r_97c26624-f81c-4ab1-97e2-2b31e7604d3c/whereabouts-cni/0.log"
May 26 16:23:01.993690 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:01.993663    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87r2b_c3b148e7-c1e0-4215-8370-7707e59cbba2/network-metrics-daemon/0.log"
May 26 16:23:02.033563 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:02.033478    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87r2b_c3b148e7-c1e0-4215-8370-7707e59cbba2/kube-rbac-proxy/0.log"
May 26 16:23:03.552617 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.552544    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-controller/0.log"
May 26 16:23:03.597699 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.597669    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/0.log"
May 26 16:23:03.604223 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.604194    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/ovn-acl-logging/1.log"
May 26 16:23:03.632973 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.632938    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/kube-rbac-proxy-node/0.log"
May 26 16:23:03.666899 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.666853    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/kube-rbac-proxy-ovn-metrics/0.log"
May 26 16:23:03.703544 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.703519    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/northd/0.log"
May 26 16:23:03.751245 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.751217    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/nbdb/0.log"
May 26 16:23:03.796987 ip-10-0-137-117 kubenswrapper[2547]: I0526 16:23:03.796964    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbhwc_d167638b-6e24-4f22-b09f-0586d64d5475/sbdb/0.log"