May 26 23:44:05.259760 ip-10-0-128-145 systemd[1]: Starting Kubernetes Kubelet...
May 26 23:44:05.778043 ip-10-0-128-145 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:44:05.778043 ip-10-0-128-145 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 23:44:05.778043 ip-10-0-128-145 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:44:05.778043 ip-10-0-128-145 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 23:44:05.778043 ip-10-0-128-145 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 23:44:05.779855 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.779771    2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788317    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788338    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788342    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788345    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788348    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788352    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788355    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:44:05.788348 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788358    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788376    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788379    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788383    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788386    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788388    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788391    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788393    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788396    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788398    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788401    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788404    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788407    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788409    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788412    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788414    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788417    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788420    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788427    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:44:05.788655 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788434    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788439    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788443    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788446    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788449    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788451    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788454    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788457    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788460    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788463    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788465    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788467    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788470    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788473    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788476    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788480    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788483    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788486    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788488    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788491    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:44:05.789106 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788494    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788496    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788499    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788501    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788504    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788506    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788509    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788511    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788514    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788516    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788519    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788522    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788527    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788530    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788534    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788536    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788539    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788541    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788544    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:44:05.789703 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788546    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788549    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788551    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788554    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788556    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788559    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788561    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788564    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788568    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788571    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788574    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788576    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788579    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788588    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788591    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788593    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788596    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788608    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788611    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:44:05.790152 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788614    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.788616    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789014    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789020    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789022    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789025    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789027    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789031    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789034    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789036    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789038    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789041    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789045    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789049    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789052    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789055    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789057    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789060    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789063    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:44:05.790633 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789065    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789068    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789072    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789075    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789078    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789080    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789083    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789086    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789089    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789091    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789094    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789096    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789099    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789103    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789106    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789109    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789111    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789114    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789117    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:44:05.791084 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789120    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789122    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789125    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789127    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789130    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789133    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789135    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789138    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789140    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789142    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789145    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789147    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789151    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789153    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789156    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789160    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789162    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789165    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789168    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789170    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:44:05.791571 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789173    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789175    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789178    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789181    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789184    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789186    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789188    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789191    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789194    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789196    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789199    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789201    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789204    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789206    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789210    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789212    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789214    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789217    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789219    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789222    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:44:05.792097 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789224    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789227    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789229    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789232    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789234    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789237    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789239    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789242    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789245    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.789247    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789966    2576 flags.go:64] FLAG: --address="0.0.0.0"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789976    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789982    2576 flags.go:64] FLAG: --anonymous-auth="true"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789987    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789992    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.789996    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790000    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790005    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790008    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790011    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790015    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790018    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 23:44:05.792596 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790021    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790024    2576 flags.go:64] FLAG: --cgroup-root=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790027    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790030    2576 flags.go:64] FLAG: --client-ca-file=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790033    2576 flags.go:64] FLAG: --cloud-config=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790036    2576 flags.go:64] FLAG: --cloud-provider="external"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790038    2576 flags.go:64] FLAG: --cluster-dns="[]"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790044    2576 flags.go:64] FLAG: --cluster-domain=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790046    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790050    2576 flags.go:64] FLAG: --config-dir=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790053    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790056    2576 flags.go:64] FLAG: --container-log-max-files="5"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790060    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790063    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790066    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790069    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790072    2576 flags.go:64] FLAG: --contention-profiling="false"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790076    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790080    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790083    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790086    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790090    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790093    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790096    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790099    2576 flags.go:64] FLAG: --enable-load-reader="false"
May 26 23:44:05.793134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790106    2576 flags.go:64] FLAG: --enable-server="true"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790109    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790113    2576 flags.go:64] FLAG: --event-burst="100"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790122    2576 flags.go:64] FLAG: --event-qps="50"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790125    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790128    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790131    2576 flags.go:64] FLAG: --eviction-hard=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790135    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790138    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790141    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790144    2576 flags.go:64] FLAG: --eviction-soft=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790147    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790150    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790153    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790156    2576 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790159    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790162    2576 flags.go:64] FLAG: --fail-swap-on="true"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790165    2576 flags.go:64] FLAG: --feature-gates=""
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790169    2576 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790173    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790176    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790179    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790182    2576 flags.go:64] FLAG: --healthz-port="10248"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790185    2576 flags.go:64] FLAG: --help="false"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790188    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-145.ec2.internal"
May 26 23:44:05.793743 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790191    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790194    2576 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790197    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790201    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790204    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790207    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790210    2576 flags.go:64] FLAG: --image-service-endpoint=""
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790213    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790222    2576 flags.go:64] FLAG: --kube-api-burst="100"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790225    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790228    2576 flags.go:64] FLAG: --kube-api-qps="50"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790231    2576 flags.go:64] FLAG: --kube-reserved=""
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790234    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790237    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790240    2576 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790243    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790246    2576 flags.go:64] FLAG: --lock-file=""
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790248    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790251    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790254    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790259    2576 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790262    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790265    2576 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 23:44:05.794397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790269    2576 flags.go:64] FLAG: --logging-format="text"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790272    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790275    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790278    2576 flags.go:64] FLAG: --manifest-url=""
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790281    2576 flags.go:64] FLAG: --manifest-url-header=""
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790285    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790289    2576 flags.go:64] FLAG: --max-open-files="1000000"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790293    2576 flags.go:64] FLAG: --max-pods="110"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790296    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790299    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790302    2576 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790305    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790308    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790311    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790314    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790321    2576 flags.go:64] FLAG: --node-status-max-images="50"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790324    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790327    2576 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790336    2576 flags.go:64] FLAG: --pod-cidr=""
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790339    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790345    2576 flags.go:64] FLAG: --pod-manifest-path=""
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790347    2576 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790350    2576 flags.go:64] FLAG: --pods-per-core="0"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790353    2576 flags.go:64] FLAG: --port="10250"
May 26 23:44:05.794944 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790356    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790359    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09aff1f8fa70bd8d3"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790373    2576 flags.go:64] FLAG: --qos-reserved=""
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790376    2576 flags.go:64] FLAG: --read-only-port="10255"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790379    2576 flags.go:64] FLAG: --register-node="true"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790382    2576 flags.go:64] FLAG: --register-schedulable="true"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790385    2576 flags.go:64] FLAG: --register-with-taints=""
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790389    2576 flags.go:64] FLAG: --registry-burst="10"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790392    2576 flags.go:64] FLAG: --registry-qps="5"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790395    2576 flags.go:64] FLAG: --reserved-cpus=""
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790397    2576 flags.go:64] FLAG: --reserved-memory=""
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790401    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790404    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790407    2576 flags.go:64] FLAG: --rotate-certificates="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790410    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790412    2576 flags.go:64] FLAG: --runonce="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790415    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790419    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790429    2576 flags.go:64] FLAG: --seccomp-default="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790433    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790435    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790438    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790441    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790444    2576 flags.go:64] FLAG: --storage-driver-password="root"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790447    2576 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790451    2576 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 23:44:05.795540 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790453    2576 flags.go:64] FLAG: --storage-driver-user="root"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790462    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790466    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790468    2576 flags.go:64] FLAG: --system-cgroups=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790471    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790477    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790479    2576 flags.go:64] FLAG: --tls-cert-file=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790482    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790489    2576 flags.go:64] FLAG: --tls-min-version=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790492    2576 flags.go:64] FLAG: --tls-private-key-file=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790495    2576 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790498    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790501    2576 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790504    2576 flags.go:64] FLAG: --v="2"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790508    2576 flags.go:64] FLAG: --version="false"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790512    2576 flags.go:64] FLAG: --vmodule=""
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790517    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.790520    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790629    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790633    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790636    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790639    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790642    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790645    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:44:05.796158 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790648    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790651    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790653    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790656    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790659    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790661    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790664    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790667    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790669    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790672    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790680    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790683    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790686    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790688    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790691    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790696    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790699    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790702    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790704    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790706    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:44:05.796758 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790709    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790712    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790714    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790717    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790719    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790722    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790725    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790727    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790730    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790732    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790735    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790737    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790740    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790742    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790745    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790747    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790749    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790752    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790755    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790757    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:44:05.797286 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790759    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790762    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790764    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790772    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790775    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790777    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790780    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790783    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790786    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790789    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790791    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790794    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790796    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790800    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790804    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790807    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790810    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790812    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790815    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:44:05.797787 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790818    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790821    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790824    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790826    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790832    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790835    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790837    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790840    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790844    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790848    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790851    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790853    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790856    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790858    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790861    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790864    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790866    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790874    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790877    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790879    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:44:05.798258 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.790883    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.791392    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.797756    2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.797770    2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797822    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797826    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797830    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797833    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797836    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797839    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797841    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797844    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797846    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797849    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797852    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797855    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:44:05.798751 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797857    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797860    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797863    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797866    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797868    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797871    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797873    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797876    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797878    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797881    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797885    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797889    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797891    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797895    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797897    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797900    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797903    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797905    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797908    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:44:05.799149 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797910    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797913    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797916    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797918    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797921    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797923    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797926    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797928    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797930    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797933    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797935    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797938    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797941    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797943    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797946    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797949    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797951    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797954    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797956    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:44:05.799615 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797959    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797961    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797964    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797968    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797972    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797975    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797978    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797980    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797984    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797987    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797989    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797992    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797995    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.797998    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798000    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798003    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798005    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798008    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798010    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:44:05.800065 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798013    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798015    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798018    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798020    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798023    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798025    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798028    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798031    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798034    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798036    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798039    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798041    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798044    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798046    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798049    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798051    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:44:05.800539 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798053    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.798059    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798161    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798166    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798169    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798172    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798175    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798179    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798182    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798184    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798187    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798189    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798192    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798194    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798197    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798199    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 23:44:05.800974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798201    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798204    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798206    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798209    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798211    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798214    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798216    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798219    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798221    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798224    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798227    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798229    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798232    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798234    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798237    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798239    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798242    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798244    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798247    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798250    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 23:44:05.801357 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798252    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798254    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798257    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798260    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798263    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798266    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798269    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798271    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798274    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798276    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798279    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798282    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798284    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798286    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798289    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798291    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798293    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798296    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798298    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 23:44:05.801839 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798302    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798306    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798309    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798312    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798315    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798317    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798320    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798323    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798327    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798330    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798333    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798336    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798339    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798342    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798345    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798347    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798351    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798354    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798356    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 23:44:05.802289 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798359    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798373    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798376    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798378    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798380    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798383    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798385    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798388    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798391    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798393    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798396    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798398    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798401    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:05.798403    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.798408    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 23:44:05.802753 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.799510    2576 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 23:44:05.803125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.801528    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 23:44:05.803125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.802454    2576 server.go:1019] "Starting client certificate rotation"
May 26 23:44:05.803125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.802551    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 23:44:05.803125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.802587    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 23:44:05.828719 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.828696    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 23:44:05.830737 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.830719    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 23:44:05.850211 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.850188    2576 log.go:25] "Validated CRI v1 runtime API"
May 26 23:44:05.856298 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.856279    2576 log.go:25] "Validated CRI v1 image API"
May 26 23:44:05.857473 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.857455    2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 23:44:05.859726 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.859709    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 23:44:05.860985 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.860965    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b814e60a-b4bc-4886-8d0c-bda64805440a:/dev/nvme0n1p3 b832da68-dfd4-49fe-8895-d3ccc1ddd1ba:/dev/nvme0n1p4]
May 26 23:44:05.861050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.860984    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 23:44:05.865759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.865660    2576 manager.go:217] Machine: {Timestamp:2026-05-26 23:44:05.865137583 +0000 UTC m=+0.468383718 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098710 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204472367946bd98859d5738856678 SystemUUID:ec204472-3679-46bd-9885-9d5738856678 BootID:1871a5c3-82de-422c-87ca-10ebcc18ae07 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:e4:82:86:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:e4:82:86:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:c1:95:da:e6:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 23:44:05.865759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.865757    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 23:44:05.865868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.865833    2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 23:44:05.868453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.868430    2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 23:44:05.868587 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.868457    2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 23:44:05.868637 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.868603    2576 topology_manager.go:138] "Creating topology manager with none policy"
May 26 23:44:05.868637 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.868613    2576 container_manager_linux.go:306] "Creating device plugin manager"
May 26 23:44:05.868637 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.868620    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 23:44:05.869355 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.869345    2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 23:44:05.871493 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.871482    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 23:44:05.871770 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.871760    2576 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 23:44:05.874480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.874470    2576 kubelet.go:491] "Attempting to sync node with API server"
May 26 23:44:05.874518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.874490    2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 23:44:05.874518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.874501    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 23:44:05.874518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.874513    2576 kubelet.go:397] "Adding apiserver pod source"
May 26 23:44:05.874640 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.874522    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 23:44:05.875636 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.875625    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 23:44:05.875680 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.875643    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 23:44:05.878606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.878588    2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 23:44:05.880450 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.880436    2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 23:44:05.881453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881434    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 23:44:05.881453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881455    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881465    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881473    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881484    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881494    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881503    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881512    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881522    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881531    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 23:44:05.881606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881543    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 23:44:05.881883 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881865    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 23:44:05.881929 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881913    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 23:44:05.881929 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.881924    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 23:44:05.883182 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.883159    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mv9wb"
May 26 23:44:05.886981 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.886957    2576 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 23:44:05.887077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.887026    2576 server.go:1295] "Started kubelet"
May 26 23:44:05.887405 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.887381    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 23:44:05.887662 ip-10-0-128-145 systemd[1]: Started Kubernetes Kubelet.
May 26 23:44:05.888417 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.888397    2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 23:44:05.888687 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.888646    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 23:44:05.888737 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.888689    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 23:44:05.888781 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.888740    2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 23:44:05.888837 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.888826    2576 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 23:44:05.890494 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.890479    2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 23:44:05.890647 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.890636    2576 server.go:317] "Adding debug handlers to kubelet server"
May 26 23:44:05.893549 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.893526    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mv9wb"
May 26 23:44:05.895165 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.895150    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 23:44:05.895732 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.895715    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 23:44:05.895932 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.895915    2576 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 23:44:05.896054 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.895935    2576 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 23:44:05.896054 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896040    2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 23:44:05.896149 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896088    2576 reconstruct.go:97] "Volume reconstruction finished"
May 26 23:44:05.896149 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896096    2576 reconciler.go:26] "Reconciler: start to sync state"
May 26 23:44:05.896438 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896421    2576 factory.go:55] Registering systemd factory
May 26 23:44:05.896518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896443    2576 factory.go:223] Registration of the systemd container factory successfully
May 26 23:44:05.896912 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.896896    2576 factory.go:153] Registering CRI-O factory
May 26 23:44:05.897030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.897017    2576 factory.go:223] Registration of the crio container factory successfully
May 26 23:44:05.897089 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.897075    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 23:44:05.897149 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.897094    2576 factory.go:103] Registering Raw factory
May 26 23:44:05.897149 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.895238    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-145.ec2.internal.18b3422ea776b3d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-145.ec2.internal,UID:ip-10-0-128-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-145.ec2.internal,},FirstTimestamp:2026-05-26 23:44:05.886981075 +0000 UTC m=+0.490227217,LastTimestamp:2026-05-26 23:44:05.886981075 +0000 UTC m=+0.490227217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-145.ec2.internal,}"
May 26 23:44:05.897149 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.897109    2576 manager.go:1196] Started watching for new ooms in manager
May 26 23:44:05.897301 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.897236    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:05.897546 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.897525    2576 manager.go:319] Starting recovery of all containers
May 26 23:44:05.899552 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.899525    2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 23:44:05.904309 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.904159    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:05.906302 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.906278    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-145.ec2.internal\" not found" node="ip-10-0-128-145.ec2.internal"
May 26 23:44:05.907275 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.907258    2576 manager.go:324] Recovery completed
May 26 23:44:05.908695 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.908679    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 26 23:44:05.911506 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.911494    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:05.913273 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913256    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:05.913353 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913282    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:05.913353 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913292    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:05.913776 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913761    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 23:44:05.913859 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913776    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 23:44:05.913859 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.913795    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 23:44:05.917687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.917673    2576 policy_none.go:49] "None policy: Start"
May 26 23:44:05.917769 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.917695    2576 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 23:44:05.917769 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.917708    2576 state_mem.go:35] "Initializing new in-memory state store"
May 26 23:44:05.953883 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.953868    2576 manager.go:341] "Starting Device Plugin manager"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.953907    2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.953917    2576 server.go:85] "Starting device plugin registration server"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.954172    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.954184    2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.954262    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.954332    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.954341    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.954874    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 23:44:05.968621 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.954904    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:05.991225 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.991197    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 23:44:05.992423 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.992403    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 23:44:05.992423 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.992426    2576 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 23:44:05.992530 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.992442    2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 23:44:05.992530 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.992448    2576 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 23:44:05.992530 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:05.992486    2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 23:44:05.994735 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:05.994718    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:06.054768 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.054698    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:06.055778 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.055762    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:06.055863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.055791    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:06.055863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.055804    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:06.055863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.055833    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-145.ec2.internal"
May 26 23:44:06.064096 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.064081    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-145.ec2.internal"
May 26 23:44:06.064177 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.064104    2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-145.ec2.internal\": node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.093253 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.093227    2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"]
May 26 23:44:06.093355 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.093312    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:06.094536 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.094519    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:06.094613 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.094547    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:06.094613 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.094558    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:06.094977 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.094959    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.095775 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.095761    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:06.095929 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.095914    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.096022 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.095951    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:06.096465 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096449    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:06.096538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096473    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:06.096538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096483    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:06.096538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096489    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:06.096538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096510    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:06.096538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.096522    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:06.097562 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.097549    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.097617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.097572    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 23:44:06.098192 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.098174    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientMemory"
May 26 23:44:06.098282 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.098204    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasNoDiskPressure"
May 26 23:44:06.098282 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.098214    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeHasSufficientPID"
May 26 23:44:06.128007 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.127982    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-145.ec2.internal\" not found" node="ip-10-0-128-145.ec2.internal"
May 26 23:44:06.132146 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.132132    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-145.ec2.internal\" not found" node="ip-10-0-128-145.ec2.internal"
May 26 23:44:06.195351 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.195323    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.196639 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.196623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c8e0f9f7c8717b0b45bd8d3f6aab997-config\") pod \"kube-apiserver-proxy-ip-10-0-128-145.ec2.internal\" (UID: \"8c8e0f9f7c8717b0b45bd8d3f6aab997\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.196700 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.196648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.196700 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.196667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.296169 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.296130    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.297268 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297250    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c8e0f9f7c8717b0b45bd8d3f6aab997-config\") pod \"kube-apiserver-proxy-ip-10-0-128-145.ec2.internal\" (UID: \"8c8e0f9f7c8717b0b45bd8d3f6aab997\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.297310 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297276    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.297310 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297294    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.297387 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297348    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.297387 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297356    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e8ad06ab332fcc508d0aab31d1fb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal\" (UID: \"279e8ad06ab332fcc508d0aab31d1fb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.297455 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.297409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c8e0f9f7c8717b0b45bd8d3f6aab997-config\") pod \"kube-apiserver-proxy-ip-10-0-128-145.ec2.internal\" (UID: \"8c8e0f9f7c8717b0b45bd8d3f6aab997\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.396821 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.396753    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.430985 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.430967    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.434736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.434712    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:06.497535 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.497489    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.597903 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.597864    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.698286 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.698212    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.798667 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.798638    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.802855 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.802841    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 23:44:06.803026 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.803001    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 23:44:06.803096 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.803057    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 23:44:06.829649 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.829627    2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:06.895536 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.895494    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 23:39:05 +0000 UTC" deadline="2028-01-10 03:50:25.182622965 +0000 UTC"
May 26 23:44:06.895536 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.895529    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14236h6m18.287097138s"
May 26 23:44:06.895536 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.895516    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 23:44:06.899191 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.899164    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:06.904503 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.904481    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 23:44:06.927173 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.927154    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqmn9"
May 26 23:44:06.932601 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.932585    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqmn9"
May 26 23:44:06.959986 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:06.959921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8e0f9f7c8717b0b45bd8d3f6aab997.slice/crio-7d012be00f2b98579995a7f8e0282995f541066fc0d7765a19d0c8f990559303 WatchSource:0}: Error finding container 7d012be00f2b98579995a7f8e0282995f541066fc0d7765a19d0c8f990559303: Status 404 returned error can't find the container with id 7d012be00f2b98579995a7f8e0282995f541066fc0d7765a19d0c8f990559303
May 26 23:44:06.960103 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:06.960089    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279e8ad06ab332fcc508d0aab31d1fb5.slice/crio-2b21cccb29773df53760feacc753bea095f0d2ff2df2778705d9eea3ed16527c WatchSource:0}: Error finding container 2b21cccb29773df53760feacc753bea095f0d2ff2df2778705d9eea3ed16527c: Status 404 returned error can't find the container with id 2b21cccb29773df53760feacc753bea095f0d2ff2df2778705d9eea3ed16527c
May 26 23:44:06.963441 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.963423    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 23:44:06.995260 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.995218    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal" event={"ID":"8c8e0f9f7c8717b0b45bd8d3f6aab997","Type":"ContainerStarted","Data":"7d012be00f2b98579995a7f8e0282995f541066fc0d7765a19d0c8f990559303"}
May 26 23:44:06.996202 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:06.996181    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal" event={"ID":"279e8ad06ab332fcc508d0aab31d1fb5","Type":"ContainerStarted","Data":"2b21cccb29773df53760feacc753bea095f0d2ff2df2778705d9eea3ed16527c"}
May 26 23:44:06.999413 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:06.999398    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:07.099843 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:07.099817    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:07.200232 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:07.200206    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-145.ec2.internal\" not found"
May 26 23:44:07.288599 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.288515    2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:07.297335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.297315    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal"
May 26 23:44:07.307559 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.307539    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 23:44:07.308781 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.308767    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal"
May 26 23:44:07.314466 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.314453    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 23:44:07.874887 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.874850    2576 apiserver.go:52] "Watching apiserver"
May 26 23:44:07.875487 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.874914    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:07.875487 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.874933    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 23:44:07.880801 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.880781    2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 23:44:07.881143 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.881124    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal","openshift-multus/multus-additional-cni-plugins-jhtt8","openshift-multus/network-metrics-daemon-n984x","openshift-network-operator/iptables-alerter-zqr9w","kube-system/konnectivity-agent-d6pzt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn","openshift-dns/node-resolver-ws8g9","openshift-multus/multus-jx9r6","openshift-network-diagnostics/network-check-target-wrfhw","openshift-ovn-kubernetes/ovnkube-node-69qqq","kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bf745","openshift-image-registry/node-ca-jbnnd"]
May 26 23:44:07.883633 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.883616    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:07.885729 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.885709    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nmd5t\""
May 26 23:44:07.885827 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.885762    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 23:44:07.885827 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.885762    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 23:44:07.886028 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.886008    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.887806 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.887784    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 23:44:07.887913 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.887891    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d4pv6\""
May 26 23:44:07.887913 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.887894    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 23:44:07.888123 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.888105    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 23:44:07.888471 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.888453    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 23:44:07.888471 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.888465    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 23:44:07.890471 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.890449    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:07.890579 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:07.890520    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:07.892471 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.892450    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:07.892570 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.892540    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:07.894434 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.894418    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 23:44:07.894583 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.894564    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rnn6d\""
May 26 23:44:07.894669 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.894565    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 23:44:07.894725 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.894681    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 23:44:07.894892 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.894871    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.895227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.895112    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 23:44:07.895227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.895119    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 23:44:07.895413 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.895284    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tb7xr\""
May 26 23:44:07.896955 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.896843    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 23:44:07.896955 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.896862    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 23:44:07.896955 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.896944    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 23:44:07.897169 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.897125    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.897228 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.897188    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-48p7d\""
May 26 23:44:07.900174 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.899316    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wddf\""
May 26 23:44:07.900174 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.899353    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 23:44:07.902838 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.902819    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:07.903092 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:07.902941    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:07.903755 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6947a497-4661-454a-8750-4779cb06423d-agent-certs\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:07.903854 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6947a497-4661-454a-8750-4779cb06423d-konnectivity-ca\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:07.903854 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-registration-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.903854 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-device-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.903854 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-sys-fs\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-bin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669xh\" (UniqueName: \"kubernetes.io/projected/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-kube-api-access-669xh\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-system-cni-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.903989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-multus-certs\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/310ab732-4829-40b6-adce-a5b52b81d43f-tmp-dir\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l758\" (UniqueName: \"kubernetes.io/projected/310ab732-4829-40b6-adce-a5b52b81d43f-kube-api-access-9l758\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-socket-dir-parent\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-hostroot\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-etc-kubernetes\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cnibin\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8f65\" (UniqueName: \"kubernetes.io/projected/cec668f2-b490-4837-a4fe-ff685a66a5f4-kube-api-access-r8f65\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cni-binary-copy\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-k8s-cni-cncf-io\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-multus\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-os-release\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6j6j\" (UniqueName: \"kubernetes.io/projected/b31e8bbf-45b2-46ca-97d5-59e7f556b489-kube-api-access-w6j6j\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-kubelet\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-conf-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-daemon-config\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/310ab732-4829-40b6-adce-a5b52b81d43f-hosts-file\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0aedc4-ab08-4357-a9af-57c938b0c685-iptables-alerter-script\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cnibin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-socket-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrcvj\" (UniqueName: \"kubernetes.io/projected/6df59971-f956-4ab6-9811-882e6efb9af0-kube-api-access-mrcvj\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0aedc4-ab08-4357-a9af-57c938b0c685-host-slash\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576nx\" (UniqueName: \"kubernetes.io/projected/cd0aedc4-ab08-4357-a9af-57c938b0c685-kube-api-access-576nx\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-system-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-os-release\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-netns\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:07.904995 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.904887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:07.905510 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.905082    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:07.905510 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.905124    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:07.907062 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907039    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 23:44:07.907150 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907044    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 23:44:07.907229 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907199    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 23:44:07.907288 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907239    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jswg6\""
May 26 23:44:07.907407 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907386    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4bhlb\""
May 26 23:44:07.907516 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907492    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:07.908032 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.907970    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 23:44:07.908098 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.908059    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 23:44:07.908148 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.908115    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 23:44:07.908202 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.908174    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 23:44:07.908324 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.908304    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 23:44:07.909377 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.909346    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 23:44:07.909565 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.909387    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 23:44:07.909771 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.909755    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 23:44:07.910036 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.910019    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f5t2j\""
May 26 23:44:07.933382 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.933348    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 23:39:06 +0000 UTC" deadline="2027-11-18 01:31:55.183796604 +0000 UTC"
May 26 23:44:07.933382 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.933382    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12961h47m47.250417746s"
May 26 23:44:07.997618 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:07.997591    2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 23:44:08.005894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.005868    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-socket-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.006026 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.005902    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrcvj\" (UniqueName: \"kubernetes.io/projected/6df59971-f956-4ab6-9811-882e6efb9af0-kube-api-access-mrcvj\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:08.006026 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.005923    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-system-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006026 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.005951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-var-lib-kubelet\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006026 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.005996    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-os-release\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006034    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-netns\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-socket-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006117    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6947a497-4661-454a-8750-4779cb06423d-konnectivity-ca\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-netns\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006149    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-registration-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-os-release\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006180    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-669xh\" (UniqueName: \"kubernetes.io/projected/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-kube-api-access-669xh\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysconfig\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006212    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-registration-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-system-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006320    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-sys\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-slash\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-node-log\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006481    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-hostroot\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006506    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-etc-kubernetes\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-conf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-tmp\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-hostroot\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-log-socket\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-etc-kubernetes\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006608    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/310ab732-4829-40b6-adce-a5b52b81d43f-hosts-file\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006636    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:08.006799 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006660    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-multus\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/310ab732-4829-40b6-adce-a5b52b81d43f-hosts-file\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-kubelet\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-netd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-multus\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006731    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6947a497-4661-454a-8750-4779cb06423d-konnectivity-ca\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006741    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.006745    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006787    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0aedc4-ab08-4357-a9af-57c938b0c685-iptables-alerter-script\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-cni-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.006827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:08.506803596 +0000 UTC m=+3.110049742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006857    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cnibin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006889    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cnibin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-modprobe-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006895    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-script-lib\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-serviceca\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.007627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.006971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qbz\" (UniqueName: \"kubernetes.io/projected/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-kube-api-access-p9qbz\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007001    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007028    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0aedc4-ab08-4357-a9af-57c938b0c685-host-slash\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007052    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-576nx\" (UniqueName: \"kubernetes.io/projected/cd0aedc4-ab08-4357-a9af-57c938b0c685-kube-api-access-576nx\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-kubernetes\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-tuned\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtmf\" (UniqueName: \"kubernetes.io/projected/99f4a489-490b-4d4b-b483-941c9dbf14ac-kube-api-access-bqtmf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-systemd-units\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovn-node-metrics-cert\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-netns\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0aedc4-ab08-4357-a9af-57c938b0c685-iptables-alerter-script\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-var-lib-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-ovn\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-bin\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-env-overrides\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7fwt\" (UniqueName: \"kubernetes.io/projected/cd4f0b10-e05e-4ba5-9334-39145d79d60c-kube-api-access-w7fwt\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.008498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007471    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007498    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6947a497-4661-454a-8750-4779cb06423d-agent-certs\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007524    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-device-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007525    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007568    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-sys-fs\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007586    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-device-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007598    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-bin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007628    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-system-cni-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007635    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007652    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-multus-certs\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007637    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-sys-fs\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-system-cni-dir\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-cni-bin\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007676    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/310ab732-4829-40b6-adce-a5b52b81d43f-tmp-dir\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007702    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l758\" (UniqueName: \"kubernetes.io/projected/310ab732-4829-40b6-adce-a5b52b81d43f-kube-api-access-9l758\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-etc-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007702    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-multus-certs\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007756    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007804    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007874    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007894    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-socket-dir-parent\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007909    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-kubelet\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007924    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-daemon-config\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-systemd\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-run\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007966    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/310ab732-4829-40b6-adce-a5b52b81d43f-tmp-dir\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007974    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cnibin\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-socket-dir-parent\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-var-lib-kubelet\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.007990    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008061    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cnibin\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008142    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8f65\" (UniqueName: \"kubernetes.io/projected/cec668f2-b490-4837-a4fe-ff685a66a5f4-kube-api-access-r8f65\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008169    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cni-binary-copy\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.009736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b31e8bbf-45b2-46ca-97d5-59e7f556b489-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008225    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cec668f2-b490-4837-a4fe-ff685a66a5f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008250    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-os-release\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0aedc4-ab08-4357-a9af-57c938b0c685-host-slash\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008308    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6j6j\" (UniqueName: \"kubernetes.io/projected/b31e8bbf-45b2-46ca-97d5-59e7f556b489-kube-api-access-w6j6j\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008358    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b31e8bbf-45b2-46ca-97d5-59e7f556b489-os-release\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008414    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-conf-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008439    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-k8s-cni-cncf-io\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-host\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008485    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-conf-dir\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008502    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-multus-daemon-config\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-config\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008509    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-host-run-k8s-cni-cncf-io\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-host\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-lib-modules\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-systemd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.010304 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.008695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-cni-binary-copy\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.011278 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.011256    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6947a497-4661-454a-8750-4779cb06423d-agent-certs\") pod \"konnectivity-agent-d6pzt\" (UID: \"6947a497-4661-454a-8750-4779cb06423d\") " pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:08.013746 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.013691    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-669xh\" (UniqueName: \"kubernetes.io/projected/0e6bff90-4110-4a6a-b1f8-87adeb86bfe2-kube-api-access-669xh\") pod \"multus-jx9r6\" (UID: \"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2\") " pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.016128 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.015720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrcvj\" (UniqueName: \"kubernetes.io/projected/6df59971-f956-4ab6-9811-882e6efb9af0-kube-api-access-mrcvj\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:08.016128 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.016093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-576nx\" (UniqueName: \"kubernetes.io/projected/cd0aedc4-ab08-4357-a9af-57c938b0c685-kube-api-access-576nx\") pod \"iptables-alerter-zqr9w\" (UID: \"cd0aedc4-ab08-4357-a9af-57c938b0c685\") " pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.016273 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.016130    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6j6j\" (UniqueName: \"kubernetes.io/projected/b31e8bbf-45b2-46ca-97d5-59e7f556b489-kube-api-access-w6j6j\") pod \"multus-additional-cni-plugins-jhtt8\" (UID: \"b31e8bbf-45b2-46ca-97d5-59e7f556b489\") " pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.016273 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.016174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8f65\" (UniqueName: \"kubernetes.io/projected/cec668f2-b490-4837-a4fe-ff685a66a5f4-kube-api-access-r8f65\") pod \"aws-ebs-csi-driver-node-tj8xn\" (UID: \"cec668f2-b490-4837-a4fe-ff685a66a5f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.017079 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.017058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l758\" (UniqueName: \"kubernetes.io/projected/310ab732-4829-40b6-adce-a5b52b81d43f-kube-api-access-9l758\") pod \"node-resolver-ws8g9\" (UID: \"310ab732-4829-40b6-adce-a5b52b81d43f\") " pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.109384 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109336    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109396    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-node-log\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109423    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-conf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109443    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-tmp\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109445    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109459    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-log-socket\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109487    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-node-log\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109538    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-log-socket\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109547    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-kubelet\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109578    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-netd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109605    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-modprobe-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-conf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109633    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-script-lib\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109651    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-kubelet\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109658    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-serviceca\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109684    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qbz\" (UniqueName: \"kubernetes.io/projected/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-kube-api-access-p9qbz\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109711    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-kubernetes\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109734    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-tuned\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-modprobe-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109761    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtmf\" (UniqueName: \"kubernetes.io/projected/99f4a489-490b-4d4b-b483-941c9dbf14ac-kube-api-access-bqtmf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109795    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-systemd-units\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109825    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovn-node-metrics-cert\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.109868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-kubernetes\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109889    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-netns\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109849    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-netns\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109942    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-var-lib-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109968    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-ovn\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109993    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-bin\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110017    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-env-overrides\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110040    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7fwt\" (UniqueName: \"kubernetes.io/projected/cd4f0b10-e05e-4ba5-9334-39145d79d60c-kube-api-access-w7fwt\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110071    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-etc-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-ovn\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110106    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-systemd\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-var-lib-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110130    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-run\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110159    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-systemd-units\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.109659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-netd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110180    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-host\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-script-lib\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110206    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-config\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.110557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-etc-openvswitch\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-host\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-systemd\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-cni-bin\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110348    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-run\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110416    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-host\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110537    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-serviceca\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110250    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-host\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110585    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-lib-modules\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110609    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-systemd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110635    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-var-lib-kubelet\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110658    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110685    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110715    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-run-systemd\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-env-overrides\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110765    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110789    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysconfig\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.111334 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110818    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-lib-modules\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110844    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-sys\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110874    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-slash\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-slash\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysctl-d\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-var-lib-kubelet\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-sysconfig\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110983    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovnkube-config\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.110993    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99f4a489-490b-4d4b-b483-941c9dbf14ac-sys\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.111009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd4f0b10-e05e-4ba5-9334-39145d79d60c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.112533 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.112144    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-etc-tuned\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112533 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.112204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99f4a489-490b-4d4b-b483-941c9dbf14ac-tmp\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.112617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.112586    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd4f0b10-e05e-4ba5-9334-39145d79d60c-ovn-node-metrics-cert\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.115647 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.115389    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:08.115647 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.115414    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:08.115647 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.115428    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:08.115647 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.115485    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:08.615468389 +0000 UTC m=+3.218714532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:08.117552 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.117528    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qbz\" (UniqueName: \"kubernetes.io/projected/d53ddee6-0228-4d40-a2c9-dac5da5abd2d-kube-api-access-p9qbz\") pod \"node-ca-jbnnd\" (UID: \"d53ddee6-0228-4d40-a2c9-dac5da5abd2d\") " pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.117984 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.117966    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7fwt\" (UniqueName: \"kubernetes.io/projected/cd4f0b10-e05e-4ba5-9334-39145d79d60c-kube-api-access-w7fwt\") pod \"ovnkube-node-69qqq\" (UID: \"cd4f0b10-e05e-4ba5-9334-39145d79d60c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.118076 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.118003    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtmf\" (UniqueName: \"kubernetes.io/projected/99f4a489-490b-4d4b-b483-941c9dbf14ac-kube-api-access-bqtmf\") pod \"tuned-bf745\" (UID: \"99f4a489-490b-4d4b-b483-941c9dbf14ac\") " pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.194548 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.194470    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ws8g9"
May 26 23:44:08.203295 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.203274    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhtt8"
May 26 23:44:08.213987 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.213966    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zqr9w"
May 26 23:44:08.219400 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.219357    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:08.226936 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.226916    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn"
May 26 23:44:08.234462 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.234442    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jx9r6"
May 26 23:44:08.241046 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.241028    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:08.247645 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.247628    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bf745"
May 26 23:44:08.253132 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.253115    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jbnnd"
May 26 23:44:08.513809 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.513732    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:08.513944 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.513853    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:08.513944 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.513907    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:09.513894467 +0000 UTC m=+4.117140589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:08.585072 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.584887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6bff90_4110_4a6a_b1f8_87adeb86bfe2.slice/crio-37b60908b3a58a654f4e99b60e5b20b8c3ef447d8387de34b0e3280eec165411 WatchSource:0}: Error finding container 37b60908b3a58a654f4e99b60e5b20b8c3ef447d8387de34b0e3280eec165411: Status 404 returned error can't find the container with id 37b60908b3a58a654f4e99b60e5b20b8c3ef447d8387de34b0e3280eec165411
May 26 23:44:08.586768 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.586738    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6947a497_4661_454a_8750_4779cb06423d.slice/crio-edd000200b9822245457003dd4faccac140f84c265d9d053a6ca66c35108a656 WatchSource:0}: Error finding container edd000200b9822245457003dd4faccac140f84c265d9d053a6ca66c35108a656: Status 404 returned error can't find the container with id edd000200b9822245457003dd4faccac140f84c265d9d053a6ca66c35108a656
May 26 23:44:08.589400 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.589375    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53ddee6_0228_4d40_a2c9_dac5da5abd2d.slice/crio-efadd4af5d142caa082e1edfc2f3d961b53047e553164966240e3476fc61c9ea WatchSource:0}: Error finding container efadd4af5d142caa082e1edfc2f3d961b53047e553164966240e3476fc61c9ea: Status 404 returned error can't find the container with id efadd4af5d142caa082e1edfc2f3d961b53047e553164966240e3476fc61c9ea
May 26 23:44:08.590236 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.590204    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310ab732_4829_40b6_adce_a5b52b81d43f.slice/crio-f47b05446061e2d118f58841795dd8cdf82e8c44b2dfcd4b2f71d88e3305375f WatchSource:0}: Error finding container f47b05446061e2d118f58841795dd8cdf82e8c44b2dfcd4b2f71d88e3305375f: Status 404 returned error can't find the container with id f47b05446061e2d118f58841795dd8cdf82e8c44b2dfcd4b2f71d88e3305375f
May 26 23:44:08.591095 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.591046    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4f0b10_e05e_4ba5_9334_39145d79d60c.slice/crio-1f8ecd35849140f5287a50d5b278338c5c4a592c685679c1e0acdae9c4c0cd78 WatchSource:0}: Error finding container 1f8ecd35849140f5287a50d5b278338c5c4a592c685679c1e0acdae9c4c0cd78: Status 404 returned error can't find the container with id 1f8ecd35849140f5287a50d5b278338c5c4a592c685679c1e0acdae9c4c0cd78
May 26 23:44:08.592053 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.592034    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31e8bbf_45b2_46ca_97d5_59e7f556b489.slice/crio-2d946064bc38d5e2863eb34a0326a03c03f5852e204a59f66f43a8ff1dc5ab77 WatchSource:0}: Error finding container 2d946064bc38d5e2863eb34a0326a03c03f5852e204a59f66f43a8ff1dc5ab77: Status 404 returned error can't find the container with id 2d946064bc38d5e2863eb34a0326a03c03f5852e204a59f66f43a8ff1dc5ab77
May 26 23:44:08.592928 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.592906    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0aedc4_ab08_4357_a9af_57c938b0c685.slice/crio-e93862780f5bfe2e3cd652d37e12458e89b6e8b940a9dd5b2db76415b4b59aaf WatchSource:0}: Error finding container e93862780f5bfe2e3cd652d37e12458e89b6e8b940a9dd5b2db76415b4b59aaf: Status 404 returned error can't find the container with id e93862780f5bfe2e3cd652d37e12458e89b6e8b940a9dd5b2db76415b4b59aaf
May 26 23:44:08.594688 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:44:08.594664    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec668f2_b490_4837_a4fe_ff685a66a5f4.slice/crio-3307703eb8d5cf09f318728ee33c9fa78e56840b9babe7233908f1ee425bf823 WatchSource:0}: Error finding container 3307703eb8d5cf09f318728ee33c9fa78e56840b9babe7233908f1ee425bf823: Status 404 returned error can't find the container with id 3307703eb8d5cf09f318728ee33c9fa78e56840b9babe7233908f1ee425bf823
May 26 23:44:08.715300 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.715106    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:08.715482 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.715237    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:08.715482 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.715340    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:08.715482 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.715350    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:08.715482 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:08.715420    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:09.715404826 +0000 UTC m=+4.318650949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:08.933736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.933702    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 23:39:06 +0000 UTC" deadline="2028-02-10 14:06:02.759680594 +0000 UTC"
May 26 23:44:08.933736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:08.933732    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14990h21m53.825951296s"
May 26 23:44:09.002483 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.002447    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn" event={"ID":"cec668f2-b490-4837-a4fe-ff685a66a5f4","Type":"ContainerStarted","Data":"3307703eb8d5cf09f318728ee33c9fa78e56840b9babe7233908f1ee425bf823"}
May 26 23:44:09.008968 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.008938    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zqr9w" event={"ID":"cd0aedc4-ab08-4357-a9af-57c938b0c685","Type":"ContainerStarted","Data":"e93862780f5bfe2e3cd652d37e12458e89b6e8b940a9dd5b2db76415b4b59aaf"}
May 26 23:44:09.010499 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.010433    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerStarted","Data":"2d946064bc38d5e2863eb34a0326a03c03f5852e204a59f66f43a8ff1dc5ab77"}
May 26 23:44:09.011724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.011665    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"1f8ecd35849140f5287a50d5b278338c5c4a592c685679c1e0acdae9c4c0cd78"}
May 26 23:44:09.013119 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.013065    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ws8g9" event={"ID":"310ab732-4829-40b6-adce-a5b52b81d43f","Type":"ContainerStarted","Data":"f47b05446061e2d118f58841795dd8cdf82e8c44b2dfcd4b2f71d88e3305375f"}
May 26 23:44:09.016190 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.016124    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbnnd" event={"ID":"d53ddee6-0228-4d40-a2c9-dac5da5abd2d","Type":"ContainerStarted","Data":"efadd4af5d142caa082e1edfc2f3d961b53047e553164966240e3476fc61c9ea"}
May 26 23:44:09.021765 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.021694    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jx9r6" event={"ID":"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2","Type":"ContainerStarted","Data":"37b60908b3a58a654f4e99b60e5b20b8c3ef447d8387de34b0e3280eec165411"}
May 26 23:44:09.024513 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.024468    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6pzt" event={"ID":"6947a497-4661-454a-8750-4779cb06423d","Type":"ContainerStarted","Data":"edd000200b9822245457003dd4faccac140f84c265d9d053a6ca66c35108a656"}
May 26 23:44:09.027507 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.027484    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal" event={"ID":"8c8e0f9f7c8717b0b45bd8d3f6aab997","Type":"ContainerStarted","Data":"a9fab947ea2ddd438585ed9b190a81c59dd5b628b3cf2429213c7a0620114223"}
May 26 23:44:09.040431 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.040390    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal" event={"ID":"279e8ad06ab332fcc508d0aab31d1fb5","Type":"ContainerDied","Data":"9fdf0f41acdda837e86e59e375461f0422769c08b4d84f2f5fbbf7eae86b3c22"}
May 26 23:44:09.040431 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.040302    2576 generic.go:358] "Generic (PLEG): container finished" podID="279e8ad06ab332fcc508d0aab31d1fb5" containerID="9fdf0f41acdda837e86e59e375461f0422769c08b4d84f2f5fbbf7eae86b3c22" exitCode=0
May 26 23:44:09.043520 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.043485    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bf745" event={"ID":"99f4a489-490b-4d4b-b483-941c9dbf14ac","Type":"ContainerStarted","Data":"5def9f0b58e84150216a8c90c55b5dcc9d62f9a65601751ae98172b6279bd7f8"}
May 26 23:44:09.061806 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.061761    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-145.ec2.internal" podStartSLOduration=2.061744963 podStartE2EDuration="2.061744963s" podCreationTimestamp="2026-05-26 23:44:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:44:09.042468806 +0000 UTC m=+3.645714952" watchObservedRunningTime="2026-05-26 23:44:09.061744963 +0000 UTC m=+3.664991108"
May 26 23:44:09.521445 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.520741    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:09.521445 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.520983    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:09.521445 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.521046    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:11.521027916 +0000 UTC m=+6.124274041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:09.723934 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:09.723286    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:09.723934 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.723456    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:09.723934 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.723474    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:09.723934 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.723487    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:09.723934 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:09.723568    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:11.72354946 +0000 UTC m=+6.326795589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:10.002610 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:10.002533    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:10.003129 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:10.002691    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:10.003129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:10.002533    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:10.003129 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:10.003036    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:10.073466 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:10.073427    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal" event={"ID":"279e8ad06ab332fcc508d0aab31d1fb5","Type":"ContainerStarted","Data":"9586fb86308f416a4ede5f9ba7c8aba9fb7db16e54bc7809845b34f29a776d16"}
May 26 23:44:10.088098 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:10.088040    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-145.ec2.internal" podStartSLOduration=3.088023016 podStartE2EDuration="3.088023016s" podCreationTimestamp="2026-05-26 23:44:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:44:10.087672261 +0000 UTC m=+4.690918404" watchObservedRunningTime="2026-05-26 23:44:10.088023016 +0000 UTC m=+4.691269161"
May 26 23:44:11.540117 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:11.540077    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:11.540642 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.540258    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:11.540642 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.540321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:15.540302208 +0000 UTC m=+10.143548333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:11.742016 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:11.741925    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:11.742192 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.742132    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:11.742192 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.742157    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:11.742192 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.742170    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:11.742401 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.742235    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:15.742214719 +0000 UTC m=+10.345460861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:11.994005 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:11.993916    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:11.994162 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:11.994053    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:11.994162 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.994057    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:11.994162 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:11.994136    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:13.993480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:13.993448    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:13.993906 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:13.993598    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:13.993906 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:13.993678    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:13.993906 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:13.993783    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:15.571903 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:15.571862    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:15.572391 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.571994    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:15.572391 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.572061    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:23.57204239 +0000 UTC m=+18.175288514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:15.773163 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:15.773116    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:15.773332 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.773319    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:15.773409 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.773338    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:15.773409 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.773352    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:15.773529 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.773451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:23.773431686 +0000 UTC m=+18.376677823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:15.993442 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:15.993356    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:15.993572 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.993507    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:15.995000 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:15.994978    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:15.995126 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:15.995064    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:17.993085 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:17.993049    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:17.993667 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:17.993061    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:17.993667 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:17.993157    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:17.993667 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:17.993275    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:19.993631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:19.993595    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:19.994055 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:19.993646    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:19.994055 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:19.993753    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:19.994055 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:19.993844    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:21.993105 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:21.993075    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:21.993463 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:21.993131    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:21.993463 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:21.993221    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:21.993463 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:21.993345    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:23.626938 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:23.626867    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:23.627322 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.627059    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:23.627322 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.627153    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:39.627129767 +0000 UTC m=+34.230375897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:23.829114 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:23.829067    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:23.829292 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.829225    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:23.829292 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.829244    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:23.829292 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.829258    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:23.829456 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.829324    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:39.829305884 +0000 UTC m=+34.432552010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:23.993224 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:23.993144    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:23.993400 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.993282    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:23.993400 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:23.993348    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:23.993535 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:23.993508    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:25.993634 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:25.993607    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:25.993982 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:25.993679    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:25.993982 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:25.993771    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:25.993982 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:25.993889    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:27.112462 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112154    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:44:27.113077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112773    2576 generic.go:358] "Generic (PLEG): container finished" podID="cd4f0b10-e05e-4ba5-9334-39145d79d60c" containerID="cdb965cf82c43e7d0cba089bd2d126c6acfffe5327c305e5f5946b01cb41a23a" exitCode=1
May 26 23:44:27.113077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112839    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"8b516f34a51b25fc019f132aa56d91c3f1c429f69b28e3e046e9af2e0392f109"}
May 26 23:44:27.113077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112866    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"e985941c47af4c5e90a8a894ee13ef355fce0b725093f698801cbb4f4699da97"}
May 26 23:44:27.113077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112881    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerDied","Data":"cdb965cf82c43e7d0cba089bd2d126c6acfffe5327c305e5f5946b01cb41a23a"}
May 26 23:44:27.113077 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.112894    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"4392a49e4f4de72c6151dadab61e33acb7806a913e96c4517446ba4ac4f69b31"}
May 26 23:44:27.114270 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.114234    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ws8g9" event={"ID":"310ab732-4829-40b6-adce-a5b52b81d43f","Type":"ContainerStarted","Data":"ca38cca185862e65eac8fbeb08285990ef0f084fe19d61ee3e747dd1b24e397d"}
May 26 23:44:27.115519 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.115490    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jbnnd" event={"ID":"d53ddee6-0228-4d40-a2c9-dac5da5abd2d","Type":"ContainerStarted","Data":"65a0d8634a88fd901d3b5fb599c0106108a6ca74422b9b1e925ea2c3b5ebc491"}
May 26 23:44:27.117020 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.116995    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jx9r6" event={"ID":"0e6bff90-4110-4a6a-b1f8-87adeb86bfe2","Type":"ContainerStarted","Data":"eb1299434af583d292e2f70636fb03de4ed85ed772b0815703f1dbcf464a9551"}
May 26 23:44:27.119331 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.119291    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d6pzt" event={"ID":"6947a497-4661-454a-8750-4779cb06423d","Type":"ContainerStarted","Data":"54673f89920f76fc8b3ee4ce911a7d5b69b75a89868f70335d2162be512c1464"}
May 26 23:44:27.120951 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.120925    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bf745" event={"ID":"99f4a489-490b-4d4b-b483-941c9dbf14ac","Type":"ContainerStarted","Data":"c0b358e249a9158cd7ba3bdaf0ebe7dc114b2fac6d46e5d01bda46a0c43da9ba"}
May 26 23:44:27.122341 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.122263    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn" event={"ID":"cec668f2-b490-4837-a4fe-ff685a66a5f4","Type":"ContainerStarted","Data":"c1ecf5b5abe6b9ae830b93f48ed5a9ca33b435755e79484032ecc1ff5ee662fe"}
May 26 23:44:27.123583 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.123561    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="b6444867812aca02d21f0fcf902a526539adcae465eddecc925acb87db88817a" exitCode=0
May 26 23:44:27.123667 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.123597    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"b6444867812aca02d21f0fcf902a526539adcae465eddecc925acb87db88817a"}
May 26 23:44:27.129576 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.129532    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ws8g9" podStartSLOduration=3.357053873 podStartE2EDuration="21.129517271s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.592053946 +0000 UTC m=+3.195300082" lastFinishedPulling="2026-05-26 23:44:26.364517355 +0000 UTC m=+20.967763480" observedRunningTime="2026-05-26 23:44:27.129317977 +0000 UTC m=+21.732564122" watchObservedRunningTime="2026-05-26 23:44:27.129517271 +0000 UTC m=+21.732763416"
May 26 23:44:27.143502 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.143456    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d6pzt" podStartSLOduration=7.241573415 podStartE2EDuration="21.143442112s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.588796102 +0000 UTC m=+3.192042224" lastFinishedPulling="2026-05-26 23:44:22.490664797 +0000 UTC m=+17.093910921" observedRunningTime="2026-05-26 23:44:27.143401831 +0000 UTC m=+21.746647976" watchObservedRunningTime="2026-05-26 23:44:27.143442112 +0000 UTC m=+21.746688260"
May 26 23:44:27.203825 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.203776    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bf745" podStartSLOduration=3.42313884 podStartE2EDuration="21.203761663s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.585219216 +0000 UTC m=+3.188465349" lastFinishedPulling="2026-05-26 23:44:26.365842036 +0000 UTC m=+20.969088172" observedRunningTime="2026-05-26 23:44:27.175311661 +0000 UTC m=+21.778557818" watchObservedRunningTime="2026-05-26 23:44:27.203761663 +0000 UTC m=+21.807007807"
May 26 23:44:27.219798 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.219741    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jx9r6" podStartSLOduration=3.406307586 podStartE2EDuration="21.219723309s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.587570012 +0000 UTC m=+3.190816135" lastFinishedPulling="2026-05-26 23:44:26.400985724 +0000 UTC m=+21.004231858" observedRunningTime="2026-05-26 23:44:27.219238309 +0000 UTC m=+21.822484465" watchObservedRunningTime="2026-05-26 23:44:27.219723309 +0000 UTC m=+21.822969455"
May 26 23:44:27.233502 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.233459    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jbnnd" podStartSLOduration=3.460038723 podStartE2EDuration="21.233443085s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.591104632 +0000 UTC m=+3.194350770" lastFinishedPulling="2026-05-26 23:44:26.364508997 +0000 UTC m=+20.967755132" observedRunningTime="2026-05-26 23:44:27.233149719 +0000 UTC m=+21.836395884" watchObservedRunningTime="2026-05-26 23:44:27.233443085 +0000 UTC m=+21.836689230"
May 26 23:44:27.731655 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.731635    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 23:44:27.966439 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.966295    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T23:44:27.731652816Z","UUID":"9d90978c-6317-4991-b165-6935cbc65d82","Handler":null,"Name":"","Endpoint":""}
May 26 23:44:27.969014 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.968994    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 23:44:27.969014 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.969019    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 23:44:27.992933 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.992904    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:27.993090 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:27.992931    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:27.993090 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:27.993029    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:27.993203 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:27.993120    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:28.127139 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.127106    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn" event={"ID":"cec668f2-b490-4837-a4fe-ff685a66a5f4","Type":"ContainerStarted","Data":"89d0da8228915b0c5d13be5e73dcfc90c89d808559297eab7d08de58dbe25a9f"}
May 26 23:44:28.128588 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.128535    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zqr9w" event={"ID":"cd0aedc4-ab08-4357-a9af-57c938b0c685","Type":"ContainerStarted","Data":"88b62655c7a96fad3da9f70d71edb6856aa561c4494f064ae01a70be18f7d6f3"}
May 26 23:44:28.131422 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.131401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:44:28.131913 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.131891    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"09a0583f098856ac37c5b09a60a20d2a5c85c4f0c32715840bd3dd1af13a71d5"}
May 26 23:44:28.132002 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.131920    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"f99b5603c663f4ad395baf19248a10721eb987c49ed32db7dff14bfea07c110c"}
May 26 23:44:28.143097 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:28.143052    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zqr9w" podStartSLOduration=12.373181206 podStartE2EDuration="22.143036728s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.594836393 +0000 UTC m=+3.198082525" lastFinishedPulling="2026-05-26 23:44:18.36469191 +0000 UTC m=+12.967938047" observedRunningTime="2026-05-26 23:44:28.142959146 +0000 UTC m=+22.746205290" watchObservedRunningTime="2026-05-26 23:44:28.143036728 +0000 UTC m=+22.746282876"
May 26 23:44:29.135896 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:29.135729    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn" event={"ID":"cec668f2-b490-4837-a4fe-ff685a66a5f4","Type":"ContainerStarted","Data":"f78d2331b218f16dc116a7d0b0b6205436f8df3b43f54d70d28af25b22abd98a"}
May 26 23:44:29.151483 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:29.151442    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tj8xn" podStartSLOduration=2.998469001 podStartE2EDuration="23.151428673s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.596283793 +0000 UTC m=+3.199529918" lastFinishedPulling="2026-05-26 23:44:28.749243468 +0000 UTC m=+23.352489590" observedRunningTime="2026-05-26 23:44:29.151325683 +0000 UTC m=+23.754571841" watchObservedRunningTime="2026-05-26 23:44:29.151428673 +0000 UTC m=+23.754674817"
May 26 23:44:29.993635 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:29.993559    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:29.993769 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:29.993694    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:29.993839 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:29.993779    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:29.993900 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:29.993875    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:30.140004 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:30.139978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:44:30.140500 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:30.140358    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"abf9fbccf10b5dc4a83949f526d77a5b70e3d6f9da40d2c57b15e949deb0a053"}
May 26 23:44:30.844703 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:30.844670    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:30.845291 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:30.845270    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:31.142664 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:31.142596    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:31.143200 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:31.143180    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d6pzt"
May 26 23:44:31.993429 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:31.992873    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:31.993429 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:31.993215    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:31.995865 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:31.993562    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:31.995865 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:31.994126    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:32.145354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.145324    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="4fa76b92d9f5076c577b0980a607d0f47413bfa707a9979e3a5d31491ed49483" exitCode=0
May 26 23:44:32.146044 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.145408    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"4fa76b92d9f5076c577b0980a607d0f47413bfa707a9979e3a5d31491ed49483"}
May 26 23:44:32.148315 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.148297    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:44:32.148631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.148611    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"1e0be6970dc410f537a5ab848b849e15d307330f84f03ca902507278ef0509ca"}
May 26 23:44:32.149051 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.149023    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:32.149051 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.149048    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:32.149164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.149157    2576 scope.go:117] "RemoveContainer" containerID="cdb965cf82c43e7d0cba089bd2d126c6acfffe5327c305e5f5946b01cb41a23a"
May 26 23:44:32.164794 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.164770    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:32.164908 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:32.164876    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:33.152524 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.152492    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="5465de634889fb72e23034dc199c78d4cb55141c908d81e9b7b196124bad5634" exitCode=0
May 26 23:44:33.153004 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.152578    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"5465de634889fb72e23034dc199c78d4cb55141c908d81e9b7b196124bad5634"}
May 26 23:44:33.155942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.155925    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:44:33.156258 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.156228    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" event={"ID":"cd4f0b10-e05e-4ba5-9334-39145d79d60c","Type":"ContainerStarted","Data":"58d1bf8d36659d3010f75d52d06c3a7e6b5e421a575b0b80807733e994c5df34"}
May 26 23:44:33.156357 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.156350    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 23:44:33.196150 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.196106    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq" podStartSLOduration=9.052380638 podStartE2EDuration="27.196092267s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.593240587 +0000 UTC m=+3.196486723" lastFinishedPulling="2026-05-26 23:44:26.736952223 +0000 UTC m=+21.340198352" observedRunningTime="2026-05-26 23:44:33.194684002 +0000 UTC m=+27.797930170" watchObservedRunningTime="2026-05-26 23:44:33.196092267 +0000 UTC m=+27.799338439"
May 26 23:44:33.724331 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.724303    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n984x"]
May 26 23:44:33.724500 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.724466    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:33.724603 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:33.724581    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:33.726508 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.726481    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrfhw"]
May 26 23:44:33.726606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:33.726572    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:33.726660 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:33.726634    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:34.161095 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:34.160890    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="ea712d5c9fe7adc3693db3bb1800465aff2b37937d0ea22f7e848ab06c12da23" exitCode=0
May 26 23:44:34.161525 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:34.160968    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"ea712d5c9fe7adc3693db3bb1800465aff2b37937d0ea22f7e848ab06c12da23"}
May 26 23:44:34.161525 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:34.161240    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 23:44:34.993056 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:34.993022    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:34.993235 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:34.993150    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:34.993235 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:34.993205    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:34.993340 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:34.993325    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:35.130351 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:35.130315    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:44:36.993341 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:36.993308    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:36.993935 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:36.993320    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:36.993935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:36.993442    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:36.993935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:36.993567    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:38.992866 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:38.992836    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:38.993484 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:38.992838    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:38.993484 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:38.992940    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrfhw" podUID="122c7638-6939-4d65-ae9a-f59d90403db0"
May 26 23:44:38.993484 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:38.993066    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:44:39.199946 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.199914    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-145.ec2.internal" event="NodeReady"
May 26 23:44:39.200109 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.200056    2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 23:44:39.246695 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.246622    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kgsgb"]
May 26 23:44:39.297624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.297583    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-txvg5"]
May 26 23:44:39.297800 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.297763    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.300269 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.300239    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 23:44:39.300418 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.300239    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 23:44:39.300483 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.300240    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pnjl\""
May 26 23:44:39.317836 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.317807    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgsgb"]
May 26 23:44:39.317836 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.317842    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txvg5"]
May 26 23:44:39.318032 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.317958    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.320084 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.320043    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 23:44:39.320199 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.320127    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 23:44:39.320296 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.320274    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gx4rr\""
May 26 23:44:39.320518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.320396    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 23:44:39.440651 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.440861 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfvb\" (UniqueName: \"kubernetes.io/projected/5a247352-647d-4a30-aa69-cc2371cf3fc6-kube-api-access-pmfvb\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.440861 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-config-volume\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.440861 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4g9z\" (UniqueName: \"kubernetes.io/projected/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-kube-api-access-g4g9z\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.441015 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.441015 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.440924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-tmp-dir\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.541986 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.541953    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4g9z\" (UniqueName: \"kubernetes.io/projected/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-kube-api-access-g4g9z\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542035    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542063    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-tmp-dir\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542110    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542135    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfvb\" (UniqueName: \"kubernetes.io/projected/5a247352-647d-4a30-aa69-cc2371cf3fc6-kube-api-access-pmfvb\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542169    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-config-volume\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.542227 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.542190    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:39.542564 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.542251    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:39.542564 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.542271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:44:40.042250339 +0000 UTC m=+34.645496474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:44:39.542564 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.542299    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:40.042288842 +0000 UTC m=+34.645534973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:39.542564 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-tmp-dir\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.542750 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.542682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-config-volume\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.553351 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.553326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4g9z\" (UniqueName: \"kubernetes.io/projected/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-kube-api-access-g4g9z\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:39.553537 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.553435    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfvb\" (UniqueName: \"kubernetes.io/projected/5a247352-647d-4a30-aa69-cc2371cf3fc6-kube-api-access-pmfvb\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:39.643388 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.643337    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:39.643611 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.643467    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:39.643611 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.643525    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:11.643513034 +0000 UTC m=+66.246759155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 23:44:39.844336 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:39.844261    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:39.844580 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.844440    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 23:44:39.844580 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.844462    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 23:44:39.844580 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.844471    2576 projected.go:194] Error preparing data for projected volume kube-api-access-lcp6q for pod openshift-network-diagnostics/network-check-target-wrfhw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:39.844580 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:39.844522    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q podName:122c7638-6939-4d65-ae9a-f59d90403db0 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:11.844509035 +0000 UTC m=+66.447755157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcp6q" (UniqueName: "kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q") pod "network-check-target-wrfhw" (UID: "122c7638-6939-4d65-ae9a-f59d90403db0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 23:44:40.046033 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.045849    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:40.046503 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.046065    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:40.046503 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:40.046004    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:40.046503 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:40.046138    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:41.046122139 +0000 UTC m=+35.649368260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:40.046503 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:40.046163    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:40.046503 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:40.046206    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:44:41.046190733 +0000 UTC m=+35.649436856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:44:40.176145 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.176104    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerStarted","Data":"e6a41e31f546a1f048909f55a20e0fbe8bc73f32f2ac3ad0e2fba40abfc64e8d"}
May 26 23:44:40.993611 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.993574    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:44:40.993785 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.993574    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:44:40.997001 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.996972    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9n4z9\""
May 26 23:44:40.997129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.997026    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 23:44:40.997129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.997064    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 23:44:40.997129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.997092    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88rwp\""
May 26 23:44:40.997129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:40.997068    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 23:44:41.052155 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:41.052127    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:41.052612 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:41.052171    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:41.052612 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:41.052261    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:41.052612 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:41.052264    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:41.052612 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:41.052308    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:43.052295521 +0000 UTC m=+37.655541643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:41.052612 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:41.052321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:44:43.052314843 +0000 UTC m=+37.655560965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:44:41.180617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:41.180581    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="e6a41e31f546a1f048909f55a20e0fbe8bc73f32f2ac3ad0e2fba40abfc64e8d" exitCode=0
May 26 23:44:41.180617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:41.180620    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"e6a41e31f546a1f048909f55a20e0fbe8bc73f32f2ac3ad0e2fba40abfc64e8d"}
May 26 23:44:42.185302 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:42.185267    2576 generic.go:358] "Generic (PLEG): container finished" podID="b31e8bbf-45b2-46ca-97d5-59e7f556b489" containerID="847dc916f5cafd0aa2a6083fb390f76191a8d5b965b70d1e0bebc6ccd9bbc5c3" exitCode=0
May 26 23:44:42.185773 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:42.185330    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerDied","Data":"847dc916f5cafd0aa2a6083fb390f76191a8d5b965b70d1e0bebc6ccd9bbc5c3"}
May 26 23:44:43.067422 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:43.067382    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:43.067620 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:43.067458    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:43.067620 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:43.067547    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:43.067620 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:43.067548    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:43.067620 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:43.067602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:44:47.06758598 +0000 UTC m=+41.670832103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:44:43.067620 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:43.067616    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:47.067609754 +0000 UTC m=+41.670855877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:43.190221 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:43.190186    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" event={"ID":"b31e8bbf-45b2-46ca-97d5-59e7f556b489","Type":"ContainerStarted","Data":"33198a39f7c11cb23af6e10c05db682ee57ee6df556d50a12c115301c3edd824"}
May 26 23:44:43.211811 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:43.211761    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jhtt8" podStartSLOduration=5.881043696 podStartE2EDuration="37.211746936s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:44:08.59495594 +0000 UTC m=+3.198202063" lastFinishedPulling="2026-05-26 23:44:39.925659163 +0000 UTC m=+34.528905303" observedRunningTime="2026-05-26 23:44:43.210282606 +0000 UTC m=+37.813528751" watchObservedRunningTime="2026-05-26 23:44:43.211746936 +0000 UTC m=+37.814993079"
May 26 23:44:47.090525 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:47.090482    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:47.090950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:47.090540    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:47.090950 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:47.090629    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:47.090950 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:47.090642    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:47.090950 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:47.090675    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:44:55.090661906 +0000 UTC m=+49.693908028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:47.090950 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:47.090703    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:44:55.090688361 +0000 UTC m=+49.693934500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:44:55.143029 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:55.142990    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:44:55.143029 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:44:55.143038    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:44:55.143467 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:55.143131    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:44:55.143467 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:55.143133    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:44:55.143467 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:55.143182    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:11.143168977 +0000 UTC m=+65.746415099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:44:55.143467 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:44:55.143195    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:45:11.143189139 +0000 UTC m=+65.746435262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:45:05.173523 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:05.173497    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69qqq"
May 26 23:45:11.153694 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.153653    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:45:11.154232 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.153712    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:45:11.154232 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.153828    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:45:11.154232 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.153855    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:45:11.154232 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.153925    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:45:43.153907145 +0000 UTC m=+97.757153271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:45:11.154232 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.153938    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:43.15393272 +0000 UTC m=+97.757178848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:45:11.657582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.657551    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:45:11.660227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.660212    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 23:45:11.668431 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.668415    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 23:45:11.668478 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:11.668468    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:15.668451209 +0000 UTC m=+130.271697336 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : secret "metrics-daemon-secret" not found
May 26 23:45:11.859177 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.859137    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:45:11.861767 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.861749    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 23:45:11.871410 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.871391    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 23:45:11.883354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.883326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcp6q\" (UniqueName: \"kubernetes.io/projected/122c7638-6939-4d65-ae9a-f59d90403db0-kube-api-access-lcp6q\") pod \"network-check-target-wrfhw\" (UID: \"122c7638-6939-4d65-ae9a-f59d90403db0\") " pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:45:11.909629 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.909554    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-88rwp\""
May 26 23:45:11.917344 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:11.917318    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:45:12.043109 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:12.043079    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrfhw"]
May 26 23:45:12.046381 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:45:12.046345    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122c7638_6939_4d65_ae9a_f59d90403db0.slice/crio-893d847ac02b641819cbcd18dae6058c1e64bd8cba7e52e188d64dbc21e715a2 WatchSource:0}: Error finding container 893d847ac02b641819cbcd18dae6058c1e64bd8cba7e52e188d64dbc21e715a2: Status 404 returned error can't find the container with id 893d847ac02b641819cbcd18dae6058c1e64bd8cba7e52e188d64dbc21e715a2
May 26 23:45:12.245303 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:12.245213    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrfhw" event={"ID":"122c7638-6939-4d65-ae9a-f59d90403db0","Type":"ContainerStarted","Data":"893d847ac02b641819cbcd18dae6058c1e64bd8cba7e52e188d64dbc21e715a2"}
May 26 23:45:15.251639 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:15.251593    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrfhw" event={"ID":"122c7638-6939-4d65-ae9a-f59d90403db0","Type":"ContainerStarted","Data":"87b2c218250abf93b3e5223ac3bd8fc56628f9221f0e2175e618ff7c80a9b469"}
May 26 23:45:15.252019 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:15.251730    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:45:15.266961 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:15.266920    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrfhw" podStartSLOduration=66.603176401 podStartE2EDuration="1m9.266909504s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:45:12.048058849 +0000 UTC m=+66.651304975" lastFinishedPulling="2026-05-26 23:45:14.711791952 +0000 UTC m=+69.315038078" observedRunningTime="2026-05-26 23:45:15.265999958 +0000 UTC m=+69.869246103" watchObservedRunningTime="2026-05-26 23:45:15.266909504 +0000 UTC m=+69.870155647"
May 26 23:45:43.172385 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:43.172328    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:45:43.172935 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:43.172405    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:45:43.172935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:43.172486    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 23:45:43.172935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:43.172514    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 23:45:43.172935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:43.172570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls podName:88a29149-3c3d-4fe9-bb08-e17eeb0c123f nodeName:}" failed. No retries permitted until 2026-05-26 23:46:47.172552327 +0000 UTC m=+161.775798449 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls") pod "dns-default-kgsgb" (UID: "88a29149-3c3d-4fe9-bb08-e17eeb0c123f") : secret "dns-default-metrics-tls" not found
May 26 23:45:43.172935 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:43.172585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert podName:5a247352-647d-4a30-aa69-cc2371cf3fc6 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:47.17257795 +0000 UTC m=+161.775824072 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert") pod "ingress-canary-txvg5" (UID: "5a247352-647d-4a30-aa69-cc2371cf3fc6") : secret "canary-serving-cert" not found
May 26 23:45:46.255936 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:46.255902    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrfhw"
May 26 23:45:58.824883 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.824843    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"]
May 26 23:45:58.827310 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.827271    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.830227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.828971    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fh6ks"]
May 26 23:45:58.830918 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.830892    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 26 23:45:58.831092 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831024    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 26 23:45:58.831487 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831290    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 23:45:58.831487 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831401    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 23:45:58.831644 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831511    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2kqc6\""
May 26 23:45:58.832491 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831881    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.832491 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.831892    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76cbb4bb96-nx9q6"]
May 26 23:45:58.834545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.834528    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.835759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835738    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 26 23:45:58.835851 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835781    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 23:45:58.835851 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835739    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 23:45:58.835950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835746    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nsx6h\""
May 26 23:45:58.835950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835749    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 26 23:45:58.835950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.835919    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"]
May 26 23:45:58.836784 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.836761    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 23:45:58.837134 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837117    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 23:45:58.837264 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837220    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2wthb\""
May 26 23:45:58.837490 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837163    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 26 23:45:58.837639 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837618    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 26 23:45:58.837735 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837646    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 26 23:45:58.837735 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.837697    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 26 23:45:58.840180 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.840161    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fh6ks"]
May 26 23:45:58.841010 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.840990    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 26 23:45:58.842903 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.842880    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76cbb4bb96-nx9q6"]
May 26 23:45:58.877133 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-snapshots\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsc47\" (UniqueName: \"kubernetes.io/projected/d94df388-34ea-444f-be64-5bbbb5733e98-kube-api-access-rsc47\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.877255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvzjz\" (UniqueName: \"kubernetes.io/projected/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-kube-api-access-fvzjz\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.877255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a61198ab-e53a-4640-8f8f-79c2532e96c3-serving-cert\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6v7f\" (UniqueName: \"kubernetes.io/projected/a61198ab-e53a-4640-8f8f-79c2532e96c3-kube-api-access-d6v7f\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-default-certificate\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-stats-auth\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-tmp\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.877657 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.877657 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.877509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.977939 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.977900    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.977939 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.977941    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-default-certificate\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.977991    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-stats-auth\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978011    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978027    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-tmp\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:58.978080    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:59.478057888 +0000 UTC m=+114.081304015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:58.978123    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978128    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:58.978145    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:45:58.978170 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:58.978178    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:45:59.478162831 +0000 UTC m=+114.081408968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978196    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:58.978219    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:45:59.478203257 +0000 UTC m=+114.081449384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978312    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-snapshots\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978348    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsc47\" (UniqueName: \"kubernetes.io/projected/d94df388-34ea-444f-be64-5bbbb5733e98-kube-api-access-rsc47\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978409    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvzjz\" (UniqueName: \"kubernetes.io/projected/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-kube-api-access-fvzjz\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978441    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978473    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a61198ab-e53a-4640-8f8f-79c2532e96c3-serving-cert\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978496    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-tmp\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.978718 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978516    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6v7f\" (UniqueName: \"kubernetes.io/projected/a61198ab-e53a-4640-8f8f-79c2532e96c3-kube-api-access-d6v7f\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.979146 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a61198ab-e53a-4640-8f8f-79c2532e96c3-snapshots\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.979146 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.978929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.979249 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.979231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-service-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.979498 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.979482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a61198ab-e53a-4640-8f8f-79c2532e96c3-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.980550 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.980531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-stats-auth\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.980911 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.980891    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-default-certificate\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:58.981120 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.981099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a61198ab-e53a-4640-8f8f-79c2532e96c3-serving-cert\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.987563 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.987543    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6v7f\" (UniqueName: \"kubernetes.io/projected/a61198ab-e53a-4640-8f8f-79c2532e96c3-kube-api-access-d6v7f\") pod \"insights-operator-78bdfb888c-fh6ks\" (UID: \"a61198ab-e53a-4640-8f8f-79c2532e96c3\") " pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:58.987684 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.987667    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvzjz\" (UniqueName: \"kubernetes.io/projected/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-kube-api-access-fvzjz\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:58.987852 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:58.987836    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsc47\" (UniqueName: \"kubernetes.io/projected/d94df388-34ea-444f-be64-5bbbb5733e98-kube-api-access-rsc47\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:59.147766 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.147658    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks"
May 26 23:45:59.278511 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.278480    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-fh6ks"]
May 26 23:45:59.281779 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:45:59.281748    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61198ab_e53a_4640_8f8f_79c2532e96c3.slice/crio-bda0e381ab2291ebb05ecbb5d2cf658e1c3e643207f98a5d1d45d928bf1f6992 WatchSource:0}: Error finding container bda0e381ab2291ebb05ecbb5d2cf658e1c3e643207f98a5d1d45d928bf1f6992: Status 404 returned error can't find the container with id bda0e381ab2291ebb05ecbb5d2cf658e1c3e643207f98a5d1d45d928bf1f6992
May 26 23:45:59.334064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.334036    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks" event={"ID":"a61198ab-e53a-4640-8f8f-79c2532e96c3","Type":"ContainerStarted","Data":"bda0e381ab2291ebb05ecbb5d2cf658e1c3e643207f98a5d1d45d928bf1f6992"}
May 26 23:45:59.481996 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.481917    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:59.481996 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.481971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:45:59.482175 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.482000    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:45:59.482175 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.482089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:00.482071264 +0000 UTC m=+115.085317389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:45:59.482175 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.482117    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:45:59.482175 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.482165    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:00.482152191 +0000 UTC m=+115.085398312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:45:59.482175 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.482117    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:45:59.482391 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.482193    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:46:00.482186625 +0000 UTC m=+115.085432747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:45:59.738798 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.738714    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"]
May 26 23:45:59.741123 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.741100    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.743231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.743127    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 23:45:59.743231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.743131    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 23:45:59.743390 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.743272    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 23:45:59.744065 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.744051    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lzk64\""
May 26 23:45:59.750286 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.750260    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"]
May 26 23:45:59.785726 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.785695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxwt\" (UniqueName: \"kubernetes.io/projected/3378257b-ed3d-4e54-8ced-21e93e0c690e-kube-api-access-scxwt\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.785851 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.785783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.846853 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.846816    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"]
May 26 23:45:59.848558 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.848537    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"
May 26 23:45:59.850850 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.850814    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 23:45:59.851217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.851196    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 23:45:59.851345 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.851231    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5mmvs\""
May 26 23:45:59.859346 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.859324    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"]
May 26 23:45:59.887092 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.887053    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scxwt\" (UniqueName: \"kubernetes.io/projected/3378257b-ed3d-4e54-8ced-21e93e0c690e-kube-api-access-scxwt\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.887256 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.887159    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.887256 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.887230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgj7x\" (UniqueName: \"kubernetes.io/projected/d3bac0fc-a4fe-4b8c-bd6c-be592d92976f-kube-api-access-cgj7x\") pod \"volume-data-source-validator-5cf8c89d64-n5rrw\" (UID: \"d3bac0fc-a4fe-4b8c-bd6c-be592d92976f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"
May 26 23:45:59.887384 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.887308    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:45:59.887384 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:45:59.887382    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:00.387350663 +0000 UTC m=+114.990596796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:45:59.896062 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.895977    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxwt\" (UniqueName: \"kubernetes.io/projected/3378257b-ed3d-4e54-8ced-21e93e0c690e-kube-api-access-scxwt\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:45:59.988312 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.988283    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgj7x\" (UniqueName: \"kubernetes.io/projected/d3bac0fc-a4fe-4b8c-bd6c-be592d92976f-kube-api-access-cgj7x\") pod \"volume-data-source-validator-5cf8c89d64-n5rrw\" (UID: \"d3bac0fc-a4fe-4b8c-bd6c-be592d92976f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"
May 26 23:45:59.996716 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:45:59.996656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgj7x\" (UniqueName: \"kubernetes.io/projected/d3bac0fc-a4fe-4b8c-bd6c-be592d92976f-kube-api-access-cgj7x\") pod \"volume-data-source-validator-5cf8c89d64-n5rrw\" (UID: \"d3bac0fc-a4fe-4b8c-bd6c-be592d92976f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"
May 26 23:46:00.158385 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.158336    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"
May 26 23:46:00.291872 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.291776    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw"]
May 26 23:46:00.295662 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:00.295635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3bac0fc_a4fe_4b8c_bd6c_be592d92976f.slice/crio-b193704eb0d57e78d062dc689314484eea5341ccc54f250c66fa131be22e9df1 WatchSource:0}: Error finding container b193704eb0d57e78d062dc689314484eea5341ccc54f250c66fa131be22e9df1: Status 404 returned error can't find the container with id b193704eb0d57e78d062dc689314484eea5341ccc54f250c66fa131be22e9df1
May 26 23:46:00.337067 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.337027    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw" event={"ID":"d3bac0fc-a4fe-4b8c-bd6c-be592d92976f","Type":"ContainerStarted","Data":"b193704eb0d57e78d062dc689314484eea5341ccc54f250c66fa131be22e9df1"}
May 26 23:46:00.393012 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.392974    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:00.393212 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.393161    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:46:00.393276 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.393241    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:01.393220805 +0000 UTC m=+115.996466949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:46:00.494528 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.494465    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:00.494704 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.494594    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:00.494704 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.494620    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:02.494602381 +0000 UTC m=+117.097848502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:46:00.494704 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.494683    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:46:00.494704 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:00.494697    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:00.494895 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.494756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:46:02.494741584 +0000 UTC m=+117.097987725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:46:00.494895 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.494813    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:46:00.494895 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:00.494848    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:02.494839086 +0000 UTC m=+117.098085208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:46:01.401894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:01.401859    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:01.402313 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:01.402036    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:46:01.402313 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:01.402124    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:03.402100118 +0000 UTC m=+118.005346253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:46:02.342393 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.342344    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks" event={"ID":"a61198ab-e53a-4640-8f8f-79c2532e96c3","Type":"ContainerStarted","Data":"b77e399fcb9a37d5d727a7236773a50c5c57c8c703c9614214ccce65bcccf354"}
May 26 23:46:02.343626 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.343602    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw" event={"ID":"d3bac0fc-a4fe-4b8c-bd6c-be592d92976f","Type":"ContainerStarted","Data":"fb61649cef881446f568ee0e1ad0e58dac6f9e9805e9b07e7b688b4721954f0c"}
May 26 23:46:02.356480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.356428    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks" podStartSLOduration=1.9325093500000001 podStartE2EDuration="4.356411051s" podCreationTimestamp="2026-05-26 23:45:58 +0000 UTC" firstStartedPulling="2026-05-26 23:45:59.28343682 +0000 UTC m=+113.886682942" lastFinishedPulling="2026-05-26 23:46:01.707338509 +0000 UTC m=+116.310584643" observedRunningTime="2026-05-26 23:46:02.355995312 +0000 UTC m=+116.959241456" watchObservedRunningTime="2026-05-26 23:46:02.356411051 +0000 UTC m=+116.959657197"
May 26 23:46:02.368771 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.368727    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-n5rrw" podStartSLOduration=1.958719308 podStartE2EDuration="3.368712561s" podCreationTimestamp="2026-05-26 23:45:59 +0000 UTC" firstStartedPulling="2026-05-26 23:46:00.297757638 +0000 UTC m=+114.901003760" lastFinishedPulling="2026-05-26 23:46:01.707750891 +0000 UTC m=+116.310997013" observedRunningTime="2026-05-26 23:46:02.368201319 +0000 UTC m=+116.971447464" watchObservedRunningTime="2026-05-26 23:46:02.368712561 +0000 UTC m=+116.971958705"
May 26 23:46:02.509568 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.509525    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.509597    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:02.509629    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:02.509736    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:02.509742    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:02.509744    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:06.509718293 +0000 UTC m=+121.112964427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:02.509809    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:06.509791503 +0000 UTC m=+121.113037628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:46:02.510036 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:02.509821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:46:06.509814651 +0000 UTC m=+121.113060773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:46:03.418162 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:03.418120    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:03.418395 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:03.418235    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:46:03.418395 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:03.418305    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:07.418286228 +0000 UTC m=+122.021532349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:46:04.896034 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:04.896005    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ws8g9_310ab732-4829-40b6-adce-a5b52b81d43f/dns-node-resolver/0.log"
May 26 23:46:05.495836 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.495810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbnnd_d53ddee6-0228-4d40-a2c9-dac5da5abd2d/node-ca/0.log"
May 26 23:46:05.873620 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.873584    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"]
May 26 23:46:05.876617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.876595    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"
May 26 23:46:05.878543 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.878514    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rmqsl\""
May 26 23:46:05.883652 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.883629    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"]
May 26 23:46:05.938173 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:05.938145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqt2\" (UniqueName: \"kubernetes.io/projected/8ee555ab-a803-4045-96f8-3bd3a6344924-kube-api-access-tjqt2\") pod \"network-check-source-7f44b6dd87-jqvtb\" (UID: \"8ee555ab-a803-4045-96f8-3bd3a6344924\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"
May 26 23:46:06.038702 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.038672    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqt2\" (UniqueName: \"kubernetes.io/projected/8ee555ab-a803-4045-96f8-3bd3a6344924-kube-api-access-tjqt2\") pod \"network-check-source-7f44b6dd87-jqvtb\" (UID: \"8ee555ab-a803-4045-96f8-3bd3a6344924\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"
May 26 23:46:06.046424 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.046390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqt2\" (UniqueName: \"kubernetes.io/projected/8ee555ab-a803-4045-96f8-3bd3a6344924-kube-api-access-tjqt2\") pod \"network-check-source-7f44b6dd87-jqvtb\" (UID: \"8ee555ab-a803-4045-96f8-3bd3a6344924\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"
May 26 23:46:06.184783 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.184710    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"
May 26 23:46:06.302621 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.302588    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb"]
May 26 23:46:06.305503 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:06.305477    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee555ab_a803_4045_96f8_3bd3a6344924.slice/crio-06db709eef910450e3200b184acdbe655e185102017523d4b110262355a967fb WatchSource:0}: Error finding container 06db709eef910450e3200b184acdbe655e185102017523d4b110262355a967fb: Status 404 returned error can't find the container with id 06db709eef910450e3200b184acdbe655e185102017523d4b110262355a967fb
May 26 23:46:06.353135 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.353112    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb" event={"ID":"8ee555ab-a803-4045-96f8-3bd3a6344924","Type":"ContainerStarted","Data":"06db709eef910450e3200b184acdbe655e185102017523d4b110262355a967fb"}
May 26 23:46:06.543445 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.543410    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:06.543611 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.543481    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:06.543611 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:06.543516    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:06.543611 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:06.543578    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:14.54355664 +0000 UTC m=+129.146802779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:46:06.543766 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:06.543625    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:46:06.543766 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:06.543670    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:14.543657712 +0000 UTC m=+129.146903834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:46:06.543766 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:06.543626    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:46:06.543766 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:06.543700    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:46:14.543694145 +0000 UTC m=+129.146940303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:46:07.355888 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.355853    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb" event={"ID":"8ee555ab-a803-4045-96f8-3bd3a6344924","Type":"ContainerStarted","Data":"f14ddaa40bcc821cce18cfcd95e72475923363e4e41427a7493d082ff5033147"}
May 26 23:46:07.369426 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.369378    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-jqvtb" podStartSLOduration=2.369350901 podStartE2EDuration="2.369350901s" podCreationTimestamp="2026-05-26 23:46:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:46:07.368974743 +0000 UTC m=+121.972220887" watchObservedRunningTime="2026-05-26 23:46:07.369350901 +0000 UTC m=+121.972597042"
May 26 23:46:07.450019 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.449984    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:07.450185 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:07.450137    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:46:07.450237 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:07.450207    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:15.45019136 +0000 UTC m=+130.053437485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:46:07.766465 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.766387    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"]
May 26 23:46:07.769287 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.769273    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.771673 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.771639    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 26 23:46:07.771862 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.771844    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 26 23:46:07.771948 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.771880    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jlcm9\""
May 26 23:46:07.771948 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.771933    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 26 23:46:07.772255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.772236    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 26 23:46:07.775776 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.775756    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"]
May 26 23:46:07.853268 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.853228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73c2c27c-8a3f-41b0-9b79-ca909459510f-config\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.853462 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.853275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8xsk\" (UniqueName: \"kubernetes.io/projected/73c2c27c-8a3f-41b0-9b79-ca909459510f-kube-api-access-x8xsk\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.853462 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.853344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73c2c27c-8a3f-41b0-9b79-ca909459510f-serving-cert\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.954206 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.954173    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73c2c27c-8a3f-41b0-9b79-ca909459510f-config\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.954206 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.954211    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8xsk\" (UniqueName: \"kubernetes.io/projected/73c2c27c-8a3f-41b0-9b79-ca909459510f-kube-api-access-x8xsk\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.954419 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.954270    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73c2c27c-8a3f-41b0-9b79-ca909459510f-serving-cert\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.954730 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.954709    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73c2c27c-8a3f-41b0-9b79-ca909459510f-config\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.956499 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.956478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/73c2c27c-8a3f-41b0-9b79-ca909459510f-serving-cert\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:07.961906 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:07.961882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8xsk\" (UniqueName: \"kubernetes.io/projected/73c2c27c-8a3f-41b0-9b79-ca909459510f-kube-api-access-x8xsk\") pod \"service-ca-operator-57b5b68b8-sn6r9\" (UID: \"73c2c27c-8a3f-41b0-9b79-ca909459510f\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:08.078436 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:08.078394    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"
May 26 23:46:08.194664 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:08.194635    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9"]
May 26 23:46:08.197752 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:08.197725    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c2c27c_8a3f_41b0_9b79_ca909459510f.slice/crio-751e9ca51940d7d9db10ced3c13b16dc8ae4dc43d2299146102a5be56060a1b4 WatchSource:0}: Error finding container 751e9ca51940d7d9db10ced3c13b16dc8ae4dc43d2299146102a5be56060a1b4: Status 404 returned error can't find the container with id 751e9ca51940d7d9db10ced3c13b16dc8ae4dc43d2299146102a5be56060a1b4
May 26 23:46:08.358727 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:08.358638    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9" event={"ID":"73c2c27c-8a3f-41b0-9b79-ca909459510f","Type":"ContainerStarted","Data":"751e9ca51940d7d9db10ced3c13b16dc8ae4dc43d2299146102a5be56060a1b4"}
May 26 23:46:11.365582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:11.365546    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9" event={"ID":"73c2c27c-8a3f-41b0-9b79-ca909459510f","Type":"ContainerStarted","Data":"0dd0eaf14734b09e7b61660ec0c36f849547e4253e2018ddd2e4740cdfc11192"}
May 26 23:46:11.380771 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:11.380094    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9" podStartSLOduration=2.136693747 podStartE2EDuration="4.38007771s" podCreationTimestamp="2026-05-26 23:46:07 +0000 UTC" firstStartedPulling="2026-05-26 23:46:08.199530188 +0000 UTC m=+122.802776330" lastFinishedPulling="2026-05-26 23:46:10.44291417 +0000 UTC m=+125.046160293" observedRunningTime="2026-05-26 23:46:11.379463743 +0000 UTC m=+125.982709900" watchObservedRunningTime="2026-05-26 23:46:11.38007771 +0000 UTC m=+125.983323856"
May 26 23:46:14.609285 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:14.609245    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:14.609422    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:14.609434    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:30.609415396 +0000 UTC m=+145.212661518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : configmap references non-existent config key: service-ca.crt
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:14.609490    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:14.609573    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:14.609603    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:14.609636    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls podName:d57bec4c-366f-4a0c-a12a-88d8dee08a8b nodeName:}" failed. No retries permitted until 2026-05-26 23:46:30.609619456 +0000 UTC m=+145.212865595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-2x4cg" (UID: "d57bec4c-366f-4a0c-a12a-88d8dee08a8b") : secret "cluster-monitoring-operator-tls" not found
May 26 23:46:14.609830 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:14.609658    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs podName:d94df388-34ea-444f-be64-5bbbb5733e98 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:30.609646929 +0000 UTC m=+145.212893056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs") pod "router-default-76cbb4bb96-nx9q6" (UID: "d94df388-34ea-444f-be64-5bbbb5733e98") : secret "router-metrics-certs-default" not found
May 26 23:46:15.517852 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:15.517801    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:15.518042 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:15.517957    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 23:46:15.518042 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:15.518027    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls podName:3378257b-ed3d-4e54-8ced-21e93e0c690e nodeName:}" failed. No retries permitted until 2026-05-26 23:46:31.518011292 +0000 UTC m=+146.121257418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls") pod "cluster-samples-operator-697587599-97srz" (UID: "3378257b-ed3d-4e54-8ced-21e93e0c690e") : secret "samples-operator-tls" not found
May 26 23:46:15.719618 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:15.719566    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:46:15.719993 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:15.719720    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 23:46:15.719993 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:15.719782    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs podName:6df59971-f956-4ab6-9811-882e6efb9af0 nodeName:}" failed. No retries permitted until 2026-05-26 23:48:17.719765994 +0000 UTC m=+252.323012127 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs") pod "network-metrics-daemon-n984x" (UID: "6df59971-f956-4ab6-9811-882e6efb9af0") : secret "metrics-daemon-secret" not found
May 26 23:46:30.631112 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.631073    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:30.631612 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.631125    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:30.631612 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.631275    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:30.631804 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.631772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94df388-34ea-444f-be64-5bbbb5733e98-service-ca-bundle\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:30.633626 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.633597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57bec4c-366f-4a0c-a12a-88d8dee08a8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-2x4cg\" (UID: \"d57bec4c-366f-4a0c-a12a-88d8dee08a8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:30.633705 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.633673    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94df388-34ea-444f-be64-5bbbb5733e98-metrics-certs\") pod \"router-default-76cbb4bb96-nx9q6\" (UID: \"d94df388-34ea-444f-be64-5bbbb5733e98\") " pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:30.642599 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.642579    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2kqc6\""
May 26 23:46:30.651219 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.651204    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"
May 26 23:46:30.654485 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.654467    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2wthb\""
May 26 23:46:30.663157 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.663141    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:30.782299 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.782260    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg"]
May 26 23:46:30.784981 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:30.784953    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57bec4c_366f_4a0c_a12a_88d8dee08a8b.slice/crio-dcd9541922de3b76b2b8332cf8965cec7bf73c308cc208c39a06786fa8b2f54e WatchSource:0}: Error finding container dcd9541922de3b76b2b8332cf8965cec7bf73c308cc208c39a06786fa8b2f54e: Status 404 returned error can't find the container with id dcd9541922de3b76b2b8332cf8965cec7bf73c308cc208c39a06786fa8b2f54e
May 26 23:46:30.796968 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:30.796946    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76cbb4bb96-nx9q6"]
May 26 23:46:30.800375 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:30.800337    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94df388_34ea_444f_be64_5bbbb5733e98.slice/crio-c3b7ae3f81c500183153ac9c1fecac7d62423fb43a3fdb8a72fe57b5d76402f5 WatchSource:0}: Error finding container c3b7ae3f81c500183153ac9c1fecac7d62423fb43a3fdb8a72fe57b5d76402f5: Status 404 returned error can't find the container with id c3b7ae3f81c500183153ac9c1fecac7d62423fb43a3fdb8a72fe57b5d76402f5
May 26 23:46:31.416122 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.416079    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6" event={"ID":"d94df388-34ea-444f-be64-5bbbb5733e98","Type":"ContainerStarted","Data":"dea8ff0a8a14d193ebbdfa265938a85a4c95d3d0a088af175996bfb4bbd36f67"}
May 26 23:46:31.416122 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.416129    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6" event={"ID":"d94df388-34ea-444f-be64-5bbbb5733e98","Type":"ContainerStarted","Data":"c3b7ae3f81c500183153ac9c1fecac7d62423fb43a3fdb8a72fe57b5d76402f5"}
May 26 23:46:31.417042 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.417023    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg" event={"ID":"d57bec4c-366f-4a0c-a12a-88d8dee08a8b","Type":"ContainerStarted","Data":"dcd9541922de3b76b2b8332cf8965cec7bf73c308cc208c39a06786fa8b2f54e"}
May 26 23:46:31.434656 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.434609    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6" podStartSLOduration=33.434598135 podStartE2EDuration="33.434598135s" podCreationTimestamp="2026-05-26 23:45:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:46:31.433834529 +0000 UTC m=+146.037080673" watchObservedRunningTime="2026-05-26 23:46:31.434598135 +0000 UTC m=+146.037844273"
May 26 23:46:31.540140 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.540101    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:31.542931 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.542906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3378257b-ed3d-4e54-8ced-21e93e0c690e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-97srz\" (UID: \"3378257b-ed3d-4e54-8ced-21e93e0c690e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:31.555600 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.555577    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lzk64\""
May 26 23:46:31.564335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.564310    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"
May 26 23:46:31.663756 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.663725    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:31.666615 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.666546    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:31.694518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:31.694485    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz"]
May 26 23:46:32.420395 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:32.420349    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz" event={"ID":"3378257b-ed3d-4e54-8ced-21e93e0c690e","Type":"ContainerStarted","Data":"ef815a619fd2ffcc092e02a06a4bfc0480530f31f419b3fb6b3593e5622b0df6"}
May 26 23:46:32.420722 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:32.420689    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:32.422098 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:32.422077    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76cbb4bb96-nx9q6"
May 26 23:46:33.424890 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:33.424570    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg" event={"ID":"d57bec4c-366f-4a0c-a12a-88d8dee08a8b","Type":"ContainerStarted","Data":"b906faf0b610a745076bb4465c80e122f7ea85ba3a0148a4072ca508837ca279"}
May 26 23:46:33.439467 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:33.439408    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-2x4cg" podStartSLOduration=33.508225291 podStartE2EDuration="35.439390137s" podCreationTimestamp="2026-05-26 23:45:58 +0000 UTC" firstStartedPulling="2026-05-26 23:46:30.786555938 +0000 UTC m=+145.389802063" lastFinishedPulling="2026-05-26 23:46:32.717720774 +0000 UTC m=+147.320966909" observedRunningTime="2026-05-26 23:46:33.438804949 +0000 UTC m=+148.042051094" watchObservedRunningTime="2026-05-26 23:46:33.439390137 +0000 UTC m=+148.042636286"
May 26 23:46:34.428852 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:34.428813    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz" event={"ID":"3378257b-ed3d-4e54-8ced-21e93e0c690e","Type":"ContainerStarted","Data":"59d3fb74a4285fdb2ed078c0ea4e91a82d573c2bbc80e3d9b9c959c1e34773f1"}
May 26 23:46:34.428852 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:34.428858    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz" event={"ID":"3378257b-ed3d-4e54-8ced-21e93e0c690e","Type":"ContainerStarted","Data":"4bebc7f7706e6e9182b27ba5eca2cf08866b9e70f062f88203a0b5ab87f0b81a"}
May 26 23:46:34.445397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:34.445337    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-97srz" podStartSLOduration=33.677742578 podStartE2EDuration="35.445322443s" podCreationTimestamp="2026-05-26 23:45:59 +0000 UTC" firstStartedPulling="2026-05-26 23:46:31.739314307 +0000 UTC m=+146.342560434" lastFinishedPulling="2026-05-26 23:46:33.506894178 +0000 UTC m=+148.110140299" observedRunningTime="2026-05-26 23:46:34.444407756 +0000 UTC m=+149.047653897" watchObservedRunningTime="2026-05-26 23:46:34.445322443 +0000 UTC m=+149.048568629"
May 26 23:46:36.709136 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.709103    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-pfqj9"]
May 26 23:46:36.712539 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.712520    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:36.714832 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.714811    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 23:46:36.714927 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.714882    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 23:46:36.715037 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.715017    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m5vgs\""
May 26 23:46:36.721587 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.721566    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-pfqj9"]
May 26 23:46:36.782998 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.782964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wtht\" (UniqueName: \"kubernetes.io/projected/69b7f995-dfa4-4014-8d41-e08104749033-kube-api-access-8wtht\") pod \"downloads-57bd96b888-pfqj9\" (UID: \"69b7f995-dfa4-4014-8d41-e08104749033\") " pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:36.809589 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.809556    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8gf6h"]
May 26 23:46:36.812502 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.812480    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.815870 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.815841    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xdcqh\""
May 26 23:46:36.815985 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.815946    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 23:46:36.816124 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.816106    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 23:46:36.824471 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.824453    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gf6h"]
May 26 23:46:36.883305 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff6bda43-6021-424c-95d6-2443c091b447-crio-socket\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.883497 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8z44\" (UniqueName: \"kubernetes.io/projected/ff6bda43-6021-424c-95d6-2443c091b447-kube-api-access-v8z44\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.883497 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff6bda43-6021-424c-95d6-2443c091b447-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.883497 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6bda43-6021-424c-95d6-2443c091b447-data-volume\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.883497 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883476    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wtht\" (UniqueName: \"kubernetes.io/projected/69b7f995-dfa4-4014-8d41-e08104749033-kube-api-access-8wtht\") pod \"downloads-57bd96b888-pfqj9\" (UID: \"69b7f995-dfa4-4014-8d41-e08104749033\") " pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:36.883697 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.883534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff6bda43-6021-424c-95d6-2443c091b447-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.891675 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.891616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wtht\" (UniqueName: \"kubernetes.io/projected/69b7f995-dfa4-4014-8d41-e08104749033-kube-api-access-8wtht\") pod \"downloads-57bd96b888-pfqj9\" (UID: \"69b7f995-dfa4-4014-8d41-e08104749033\") " pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:36.960394 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.960350    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:46:36.963452 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.963435    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:36.965765 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.965747    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 23:46:36.965978 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.965958    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 23:46:36.966053 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.965958    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 23:46:36.966053 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.965966    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 23:46:36.966053 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.965980    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qkjcw\""
May 26 23:46:36.966505 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.966488    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 23:46:36.971104 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.971085    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:46:36.984500 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984476    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6bda43-6021-424c-95d6-2443c091b447-data-volume\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984644 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984622    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff6bda43-6021-424c-95d6-2443c091b447-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984722 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984703    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff6bda43-6021-424c-95d6-2443c091b447-crio-socket\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984779 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984749    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8z44\" (UniqueName: \"kubernetes.io/projected/ff6bda43-6021-424c-95d6-2443c091b447-kube-api-access-v8z44\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984779 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6bda43-6021-424c-95d6-2443c091b447-data-volume\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984877 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff6bda43-6021-424c-95d6-2443c091b447-crio-socket\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.984959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.984940    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff6bda43-6021-424c-95d6-2443c091b447-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.985377 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.985349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff6bda43-6021-424c-95d6-2443c091b447-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:36.986817 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:36.986799    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff6bda43-6021-424c-95d6-2443c091b447-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:37.008716 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.008689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8z44\" (UniqueName: \"kubernetes.io/projected/ff6bda43-6021-424c-95d6-2443c091b447-kube-api-access-v8z44\") pod \"insights-runtime-extractor-8gf6h\" (UID: \"ff6bda43-6021-424c-95d6-2443c091b447\") " pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:37.021750 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.021727    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:37.085813 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.085701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.085952 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.085838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.085952 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.085892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.085952 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.085913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.085952 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.085942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.086160 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.086032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8ph\" (UniqueName: \"kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.121196 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.121161    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8gf6h"
May 26 23:46:37.145236 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.145163    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-pfqj9"]
May 26 23:46:37.148046 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:37.148020    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b7f995_dfa4_4014_8d41_e08104749033.slice/crio-908f239fad672b5862669aff4eaa7c9aa9d6ef2259ea24e0f699bdb63062d16c WatchSource:0}: Error finding container 908f239fad672b5862669aff4eaa7c9aa9d6ef2259ea24e0f699bdb63062d16c: Status 404 returned error can't find the container with id 908f239fad672b5862669aff4eaa7c9aa9d6ef2259ea24e0f699bdb63062d16c
May 26 23:46:37.186733 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186706    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.186882 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186740    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.186882 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186759    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.186882 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186784    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.186882 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186826    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8ph\" (UniqueName: \"kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.187070 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.186886    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.187579 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.187557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.187686 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.187660    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.187744 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.187687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.189220 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.189202    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.189347 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.189332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.205255 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.205228    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8ph\" (UniqueName: \"kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph\") pod \"console-76488b9466-n4v9m\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") " pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.244840 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.244811    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8gf6h"]
May 26 23:46:37.247310 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:37.247287    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6bda43_6021_424c_95d6_2443c091b447.slice/crio-d681ea7b20a29b00852ed74849a161ee548cebce0c716b99af84e22b194c3b01 WatchSource:0}: Error finding container d681ea7b20a29b00852ed74849a161ee548cebce0c716b99af84e22b194c3b01: Status 404 returned error can't find the container with id d681ea7b20a29b00852ed74849a161ee548cebce0c716b99af84e22b194c3b01
May 26 23:46:37.272721 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.272693    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:37.399252 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.399181    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:46:37.402009 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:37.401986    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4f9389_690c_415b_a3de_9426744d8e83.slice/crio-d9ff86f502c38cd6bd3b5161555433dd8e15a3a38bf3017e5ef66d1faf3a8960 WatchSource:0}: Error finding container d9ff86f502c38cd6bd3b5161555433dd8e15a3a38bf3017e5ef66d1faf3a8960: Status 404 returned error can't find the container with id d9ff86f502c38cd6bd3b5161555433dd8e15a3a38bf3017e5ef66d1faf3a8960
May 26 23:46:37.439887 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.439854    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76488b9466-n4v9m" event={"ID":"cf4f9389-690c-415b-a3de-9426744d8e83","Type":"ContainerStarted","Data":"d9ff86f502c38cd6bd3b5161555433dd8e15a3a38bf3017e5ef66d1faf3a8960"}
May 26 23:46:37.441112 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.441087    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gf6h" event={"ID":"ff6bda43-6021-424c-95d6-2443c091b447","Type":"ContainerStarted","Data":"6572636cf900110c8dd8ec9e1abadda9cd2fb98f067cd77065914b2137fc3521"}
May 26 23:46:37.441217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.441119    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gf6h" event={"ID":"ff6bda43-6021-424c-95d6-2443c091b447","Type":"ContainerStarted","Data":"d681ea7b20a29b00852ed74849a161ee548cebce0c716b99af84e22b194c3b01"}
May 26 23:46:37.442017 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:37.441997    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-pfqj9" event={"ID":"69b7f995-dfa4-4014-8d41-e08104749033","Type":"ContainerStarted","Data":"908f239fad672b5862669aff4eaa7c9aa9d6ef2259ea24e0f699bdb63062d16c"}
May 26 23:46:38.447755 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:38.447710    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gf6h" event={"ID":"ff6bda43-6021-424c-95d6-2443c091b447","Type":"ContainerStarted","Data":"32022cdd5c184a2a5242deac5cb88e15a56e982280c34690ad7b963d37536a35"}
May 26 23:46:38.951321 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:38.950249    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:46:38.953584 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:38.953559    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:38.960623 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:38.960597    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 23:46:38.964307 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:38.964261    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:46:39.102298 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6b8\" (UniqueName: \"kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.102748 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.102505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.203862    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.203913    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.203941    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6b8\" (UniqueName: \"kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.203978    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.204007    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.204032    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.204916 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.204126    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.205399 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.204971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.205399 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.205133    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.205513 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.205419    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.205844 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.205820    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.207434 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.207409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.208911 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.208877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.213150 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.213130    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6b8\" (UniqueName: \"kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8\") pod \"console-84dfff84ff-7p4fx\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") " pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.267442 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.267408    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:39.603917 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:39.603720    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:46:40.697760 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:40.697726    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e45027_db43_466e_9565_48f278762bdf.slice/crio-9bda925a73e5639a6a1bf556199338e91da3cbf371c0f6a047030cffa38e9f8e WatchSource:0}: Error finding container 9bda925a73e5639a6a1bf556199338e91da3cbf371c0f6a047030cffa38e9f8e: Status 404 returned error can't find the container with id 9bda925a73e5639a6a1bf556199338e91da3cbf371c0f6a047030cffa38e9f8e
May 26 23:46:41.458802 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.458716    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76488b9466-n4v9m" event={"ID":"cf4f9389-690c-415b-a3de-9426744d8e83","Type":"ContainerStarted","Data":"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"}
May 26 23:46:41.461022 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.460995    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8gf6h" event={"ID":"ff6bda43-6021-424c-95d6-2443c091b447","Type":"ContainerStarted","Data":"32ffd1f47045599a38d290d76d3a493aff014b4ad46bae158cd9a196195d2fec"}
May 26 23:46:41.462469 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.462444    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfff84ff-7p4fx" event={"ID":"75e45027-db43-466e-9565-48f278762bdf","Type":"ContainerStarted","Data":"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"}
May 26 23:46:41.462598 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.462475    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfff84ff-7p4fx" event={"ID":"75e45027-db43-466e-9565-48f278762bdf","Type":"ContainerStarted","Data":"9bda925a73e5639a6a1bf556199338e91da3cbf371c0f6a047030cffa38e9f8e"}
May 26 23:46:41.477457 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.477412    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76488b9466-n4v9m" podStartSLOduration=2.13159522 podStartE2EDuration="5.477396361s" podCreationTimestamp="2026-05-26 23:46:36 +0000 UTC" firstStartedPulling="2026-05-26 23:46:37.403771252 +0000 UTC m=+152.007017374" lastFinishedPulling="2026-05-26 23:46:40.749572393 +0000 UTC m=+155.352818515" observedRunningTime="2026-05-26 23:46:41.476247289 +0000 UTC m=+156.079493454" watchObservedRunningTime="2026-05-26 23:46:41.477396361 +0000 UTC m=+156.080642508"
May 26 23:46:41.503513 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.503459    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8gf6h" podStartSLOduration=3.310293412 podStartE2EDuration="5.503443718s" podCreationTimestamp="2026-05-26 23:46:36 +0000 UTC" firstStartedPulling="2026-05-26 23:46:37.31443862 +0000 UTC m=+151.917684743" lastFinishedPulling="2026-05-26 23:46:39.507588918 +0000 UTC m=+154.110835049" observedRunningTime="2026-05-26 23:46:41.502518162 +0000 UTC m=+156.105764319" watchObservedRunningTime="2026-05-26 23:46:41.503443718 +0000 UTC m=+156.106689895"
May 26 23:46:41.517980 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:41.517933    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84dfff84ff-7p4fx" podStartSLOduration=3.149151768 podStartE2EDuration="3.517918416s" podCreationTimestamp="2026-05-26 23:46:38 +0000 UTC" firstStartedPulling="2026-05-26 23:46:40.700618148 +0000 UTC m=+155.303864277" lastFinishedPulling="2026-05-26 23:46:41.069384786 +0000 UTC m=+155.672630925" observedRunningTime="2026-05-26 23:46:41.517155647 +0000 UTC m=+156.120401802" watchObservedRunningTime="2026-05-26 23:46:41.517918416 +0000 UTC m=+156.121164559"
May 26 23:46:42.310844 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:42.310796    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kgsgb" podUID="88a29149-3c3d-4fe9-bb08-e17eeb0c123f"
May 26 23:46:42.328020 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:42.327977    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-txvg5" podUID="5a247352-647d-4a30-aa69-cc2371cf3fc6"
May 26 23:46:42.465399 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:42.465355    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgsgb"
May 26 23:46:44.003776 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:44.003740    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n984x" podUID="6df59971-f956-4ab6-9811-882e6efb9af0"
May 26 23:46:44.609095 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.609047    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"]
May 26 23:46:44.612955 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.612926    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-62ljk"]
May 26 23:46:44.613138 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.613096    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.615654 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.615617    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 23:46:44.615774 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.615692    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 23:46:44.615966 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.615940    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2jphz\""
May 26 23:46:44.616068 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.616050    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.616539 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.616522    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 23:46:44.618127 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.618107    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 23:46:44.618736 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.618717    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 23:46:44.618998 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.618979    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 23:46:44.618998 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.618991    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v42w5\""
May 26 23:46:44.629632 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.629607    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"]
May 26 23:46:44.747252 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.747453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea04bd9e-b3f0-4177-bf15-b4d863a79347-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.747453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwvl\" (UniqueName: \"kubernetes.io/projected/ea04bd9e-b3f0-4177-bf15-b4d863a79347-kube-api-access-mgwvl\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.747453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-root\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747453 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-metrics-client-ca\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-textfile\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mwf\" (UniqueName: \"kubernetes.io/projected/3e2ccfa9-1859-48e8-ab12-a56e130a6609-kube-api-access-v7mwf\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-sys\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-accelerators-collector-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747653 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-wtmp\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.747873 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.747873 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.747736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.848714 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.848674    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.848714 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.848718    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.848963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.848773    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.848963 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:44.848856    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 26 23:46:44.848963 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:44.848901    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 23:46:44.848963 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:44.848934    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls podName:ea04bd9e-b3f0-4177-bf15-b4d863a79347 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:45.348911641 +0000 UTC m=+159.952157768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-b9x6b" (UID: "ea04bd9e-b3f0-4177-bf15-b4d863a79347") : secret "openshift-state-metrics-tls" not found
May 26 23:46:44.848963 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:46:44.848959    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls podName:3e2ccfa9-1859-48e8-ab12-a56e130a6609 nodeName:}" failed. No retries permitted until 2026-05-26 23:46:45.348941649 +0000 UTC m=+159.952187785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls") pod "node-exporter-62ljk" (UID: "3e2ccfa9-1859-48e8-ab12-a56e130a6609") : secret "node-exporter-tls" not found
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.848984    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea04bd9e-b3f0-4177-bf15-b4d863a79347-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849016    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwvl\" (UniqueName: \"kubernetes.io/projected/ea04bd9e-b3f0-4177-bf15-b4d863a79347-kube-api-access-mgwvl\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849054    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-root\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849103    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-metrics-client-ca\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849136    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-textfile\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849164    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mwf\" (UniqueName: \"kubernetes.io/projected/3e2ccfa9-1859-48e8-ab12-a56e130a6609-kube-api-access-v7mwf\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849184    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-root\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849217 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849199    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-sys\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849245    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-sys\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849263    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849306    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-accelerators-collector-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849343    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-wtmp\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-wtmp\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849540    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-textfile\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849624 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849624    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-metrics-client-ca\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.849976 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849779    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea04bd9e-b3f0-4177-bf15-b4d863a79347-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.849976 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.849956    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-accelerators-collector-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.851637 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.851594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:44.852117 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.852092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.860515 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.860451    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mwf\" (UniqueName: \"kubernetes.io/projected/3e2ccfa9-1859-48e8-ab12-a56e130a6609-kube-api-access-v7mwf\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:44.860868 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:44.860850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwvl\" (UniqueName: \"kubernetes.io/projected/ea04bd9e-b3f0-4177-bf15-b4d863a79347-kube-api-access-mgwvl\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:45.352979 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.352933    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:45.353437 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.352987    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:45.355591 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.355569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e2ccfa9-1859-48e8-ab12-a56e130a6609-node-exporter-tls\") pod \"node-exporter-62ljk\" (UID: \"3e2ccfa9-1859-48e8-ab12-a56e130a6609\") " pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:45.355717 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.355697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea04bd9e-b3f0-4177-bf15-b4d863a79347-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-b9x6b\" (UID: \"ea04bd9e-b3f0-4177-bf15-b4d863a79347\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:45.526464 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.526430    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"
May 26 23:46:45.532778 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.532749    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-62ljk"
May 26 23:46:45.540812 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:45.540776    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2ccfa9_1859_48e8_ab12_a56e130a6609.slice/crio-b899f4de318f47174cda0cebaae9c4aadeb849b42ce8e16801a200f9a9c0f422 WatchSource:0}: Error finding container b899f4de318f47174cda0cebaae9c4aadeb849b42ce8e16801a200f9a9c0f422: Status 404 returned error can't find the container with id b899f4de318f47174cda0cebaae9c4aadeb849b42ce8e16801a200f9a9c0f422
May 26 23:46:45.660437 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.660407    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:46:45.665764 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.665703    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.667908 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.667883    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 23:46:45.668392 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668164    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 23:46:45.668392 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668191    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 23:46:45.668392 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668212    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 23:46:45.668392 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668212    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 23:46:45.668392 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668220    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 23:46:45.668707 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668498    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 23:46:45.668707 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668547    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wwfrc\""
May 26 23:46:45.668707 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668663    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 23:46:45.669129 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.668956    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 23:46:45.671432 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.671414    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b"]
May 26 23:46:45.674657 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:45.674610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea04bd9e_b3f0_4177_bf15_b4d863a79347.slice/crio-8f2339addf7063d15a5ab0cbda43706576fd4f6e9913e21df7ae9099af215f2e WatchSource:0}: Error finding container 8f2339addf7063d15a5ab0cbda43706576fd4f6e9913e21df7ae9099af215f2e: Status 404 returned error can't find the container with id 8f2339addf7063d15a5ab0cbda43706576fd4f6e9913e21df7ae9099af215f2e
May 26 23:46:45.678137 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.678114    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:46:45.756792 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.756763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.756918 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.756804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.756918 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.756872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757028 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.756933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757028 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.756963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757028 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757152 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757152 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757152 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757250 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqn7\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757250 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757338 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.757338 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.757309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858534 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858489    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqn7\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858545    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858601    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858622    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858659    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858687 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858675    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858691    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858737    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858761    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858791    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858822    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858853    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.858967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.858909    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.860038 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.859792    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.860038 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.859994    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.862428 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.862357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.865391 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.864594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.865391 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.864986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.865391 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.865242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.867926 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.867856    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqn7\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.868690 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.868653    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.869124 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.869084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.869487 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.869464    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.869579 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.869559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.870091 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.870067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.871500 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.871477    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:45.977289 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:45.977252    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:46:46.135934 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.135905    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:46:46.139211 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:46.139180    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bedb62_6166_40c0_b080_e642466f70d9.slice/crio-29b1ddb7045798439ce69e5c2b084c6ffbd0de843e0c5beeee39057df83bb740 WatchSource:0}: Error finding container 29b1ddb7045798439ce69e5c2b084c6ffbd0de843e0c5beeee39057df83bb740: Status 404 returned error can't find the container with id 29b1ddb7045798439ce69e5c2b084c6ffbd0de843e0c5beeee39057df83bb740
May 26 23:46:46.483416 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.483145    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"29b1ddb7045798439ce69e5c2b084c6ffbd0de843e0c5beeee39057df83bb740"}
May 26 23:46:46.485055 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.485008    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62ljk" event={"ID":"3e2ccfa9-1859-48e8-ab12-a56e130a6609","Type":"ContainerStarted","Data":"b899f4de318f47174cda0cebaae9c4aadeb849b42ce8e16801a200f9a9c0f422"}
May 26 23:46:46.487298 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.487269    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b" event={"ID":"ea04bd9e-b3f0-4177-bf15-b4d863a79347","Type":"ContainerStarted","Data":"de6a5106a2f8e13c82f3a1bb13f96d06127b8a563d9aa52441f086aeaf764b9c"}
May 26 23:46:46.487433 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.487308    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b" event={"ID":"ea04bd9e-b3f0-4177-bf15-b4d863a79347","Type":"ContainerStarted","Data":"3c75317accff75b9184f866a5913609865fc74c232584e7969bbf8a90eec0b55"}
May 26 23:46:46.487433 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:46.487323    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b" event={"ID":"ea04bd9e-b3f0-4177-bf15-b4d863a79347","Type":"ContainerStarted","Data":"8f2339addf7063d15a5ab0cbda43706576fd4f6e9913e21df7ae9099af215f2e"}
May 26 23:46:47.273033 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.272564    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:46:47.273033 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.272634    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:46:47.273256 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.273119    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:47.273256 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.273164    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:46:47.274414 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.274381    2576 patch_prober.go:28] interesting pod/console-76488b9466-n4v9m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
May 26 23:46:47.274537 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.274438    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76488b9466-n4v9m" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
May 26 23:46:47.275256 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.275229    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88a29149-3c3d-4fe9-bb08-e17eeb0c123f-metrics-tls\") pod \"dns-default-kgsgb\" (UID: \"88a29149-3c3d-4fe9-bb08-e17eeb0c123f\") " pod="openshift-dns/dns-default-kgsgb"
May 26 23:46:47.275435 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.275418    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a247352-647d-4a30-aa69-cc2371cf3fc6-cert\") pod \"ingress-canary-txvg5\" (UID: \"5a247352-647d-4a30-aa69-cc2371cf3fc6\") " pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:46:47.491928 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.491837    2576 generic.go:358] "Generic (PLEG): container finished" podID="3e2ccfa9-1859-48e8-ab12-a56e130a6609" containerID="6ee17f393db0125251f1b405de43c3b609988142fed30c8dc069a67f4fee5c1d" exitCode=0
May 26 23:46:47.492360 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.491915    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62ljk" event={"ID":"3e2ccfa9-1859-48e8-ab12-a56e130a6609","Type":"ContainerDied","Data":"6ee17f393db0125251f1b405de43c3b609988142fed30c8dc069a67f4fee5c1d"}
May 26 23:46:47.568763 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.568733    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pnjl\""
May 26 23:46:47.577774 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:47.577749    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kgsgb"
May 26 23:46:49.268003 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:49.267965    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:49.268460 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:49.268062    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:49.269626 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:49.269592    2576 patch_prober.go:28] interesting pod/console-84dfff84ff-7p4fx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
May 26 23:46:49.269738 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:49.269642    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-84dfff84ff-7p4fx" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
May 26 23:46:50.844942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.844905    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:46:50.849098 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.849078    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:50.851593 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.851532    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cr28qdvp3ml8k\""
May 26 23:46:50.851715 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.851598    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 23:46:50.851838 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.851783    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 23:46:50.852145 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852121    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 23:46:50.852231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852162    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxz7k\""
May 26 23:46:50.852231 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852204    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 23:46:50.852346 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852121    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 23:46:50.852942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852661    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 23:46:50.852942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852714    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 23:46:50.852942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852725    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 23:46:50.852942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852670    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 23:46:50.852942 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.852666    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 23:46:50.853331 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.853161    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 23:46:50.862941 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.862921    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 23:46:50.864058 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.864034    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:46:50.864390 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:50.864352    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 23:46:51.009517 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009517 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.009757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.009955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.010005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010415 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.010069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9gdt\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010415 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.010114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.010415 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.010140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.110864 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110775    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.110864 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110843    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110868    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110895    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110926    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9gdt\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110960    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.110984    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111064 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111031    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111064    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111094    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111121    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111152    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111207    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111234    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111300    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111352 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111332    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111494    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111532    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.111761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.112007 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.111980    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.113874 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.113849    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.114526 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.114209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.114526 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.114230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.114526 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.114423    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.114968 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.114910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.115078 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.114972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.115078 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.115062    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.115545 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.115487    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.116506 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.116461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.117030 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.116986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.117435 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.117405    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.117538 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.117519    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.117707 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.117686    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.120101 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.120078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9gdt\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt\") pod \"prometheus-k8s-0\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:51.166566 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:51.166533    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:46:52.958645 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:52.958608    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:46:52.992858 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:52.992826    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:46:52.995063 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:52.995041    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gx4rr\""
May 26 23:46:53.003832 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:53.003811    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txvg5"
May 26 23:46:54.401867 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.399891    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txvg5"]
May 26 23:46:54.414676 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:54.414648    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a247352_647d_4a30_aa69_cc2371cf3fc6.slice/crio-c2b45102429c6af6f96707e11288c787c5c060bc37c20dfce1d58f3d14587b44 WatchSource:0}: Error finding container c2b45102429c6af6f96707e11288c787c5c060bc37c20dfce1d58f3d14587b44: Status 404 returned error can't find the container with id c2b45102429c6af6f96707e11288c787c5c060bc37c20dfce1d58f3d14587b44
May 26 23:46:54.513409 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.513281    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-pfqj9" event={"ID":"69b7f995-dfa4-4014-8d41-e08104749033","Type":"ContainerStarted","Data":"54cea6720904239cd756771d24972eae95118b7d43732e5e017539fa83dbcd59"}
May 26 23:46:54.513654 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.513635    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:54.514781 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.514759    2576 patch_prober.go:28] interesting pod/downloads-57bd96b888-pfqj9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body=
May 26 23:46:54.514901 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.514808    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-pfqj9" podUID="69b7f995-dfa4-4014-8d41-e08104749033" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused"
May 26 23:46:54.515326 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.515301    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62ljk" event={"ID":"3e2ccfa9-1859-48e8-ab12-a56e130a6609","Type":"ContainerStarted","Data":"126e6635ca9ea1ff928f51256daf4c5625097c33ca31b68cc1470531c879ca88"}
May 26 23:46:54.515416 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.515328    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62ljk" event={"ID":"3e2ccfa9-1859-48e8-ab12-a56e130a6609","Type":"ContainerStarted","Data":"b472d649ff175c1688d1978571fdefef7d2c2a7a90867784d71f387b15b7f28e"}
May 26 23:46:54.517178 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.517156    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b" event={"ID":"ea04bd9e-b3f0-4177-bf15-b4d863a79347","Type":"ContainerStarted","Data":"86079782d4a687b2488e8c4007234b7cb01a3caf4ba67dee8edc79a1b1a607f6"}
May 26 23:46:54.518234 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.518215    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txvg5" event={"ID":"5a247352-647d-4a30-aa69-cc2371cf3fc6","Type":"ContainerStarted","Data":"c2b45102429c6af6f96707e11288c787c5c060bc37c20dfce1d58f3d14587b44"}
May 26 23:46:54.519857 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.519838    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893" exitCode=0
May 26 23:46:54.519934 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.519873    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"}
May 26 23:46:54.532437 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.532388    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-pfqj9" podStartSLOduration=1.388664878 podStartE2EDuration="18.532343576s" podCreationTimestamp="2026-05-26 23:46:36 +0000 UTC" firstStartedPulling="2026-05-26 23:46:37.150350914 +0000 UTC m=+151.753597040" lastFinishedPulling="2026-05-26 23:46:54.294029601 +0000 UTC m=+168.897275738" observedRunningTime="2026-05-26 23:46:54.530594505 +0000 UTC m=+169.133840649" watchObservedRunningTime="2026-05-26 23:46:54.532343576 +0000 UTC m=+169.135589722"
May 26 23:46:54.548567 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.548519    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-62ljk" podStartSLOduration=9.442726427 podStartE2EDuration="10.548505448s" podCreationTimestamp="2026-05-26 23:46:44 +0000 UTC" firstStartedPulling="2026-05-26 23:46:45.542417128 +0000 UTC m=+160.145663253" lastFinishedPulling="2026-05-26 23:46:46.648196137 +0000 UTC m=+161.251442274" observedRunningTime="2026-05-26 23:46:54.547235028 +0000 UTC m=+169.150481173" watchObservedRunningTime="2026-05-26 23:46:54.548505448 +0000 UTC m=+169.151751592"
May 26 23:46:54.562073 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.562015    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-b9x6b" podStartSLOduration=9.247087288 podStartE2EDuration="10.56200021s" podCreationTimestamp="2026-05-26 23:46:44 +0000 UTC" firstStartedPulling="2026-05-26 23:46:45.803957282 +0000 UTC m=+160.407203417" lastFinishedPulling="2026-05-26 23:46:47.118870204 +0000 UTC m=+161.722116339" observedRunningTime="2026-05-26 23:46:54.560856171 +0000 UTC m=+169.164102318" watchObservedRunningTime="2026-05-26 23:46:54.56200021 +0000 UTC m=+169.165246357"
May 26 23:46:54.623861 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.623779    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kgsgb"]
May 26 23:46:54.626045 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:54.626016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a29149_3c3d_4fe9_bb08_e17eeb0c123f.slice/crio-7de9bf6392ed1144fe114a0cf463c0f602283b57fdf46cd3d03429b04b33d6fd WatchSource:0}: Error finding container 7de9bf6392ed1144fe114a0cf463c0f602283b57fdf46cd3d03429b04b33d6fd: Status 404 returned error can't find the container with id 7de9bf6392ed1144fe114a0cf463c0f602283b57fdf46cd3d03429b04b33d6fd
May 26 23:46:54.633135 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.633109    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:46:54.636301 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:46:54.636273    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c5a430_deb7_4bba_b590_93b971efbbbc.slice/crio-c6c7969347aaeae5416182e50742ac05d4a3b3a3bb19907e65c0fbb04d683460 WatchSource:0}: Error finding container c6c7969347aaeae5416182e50742ac05d4a3b3a3bb19907e65c0fbb04d683460: Status 404 returned error can't find the container with id c6c7969347aaeae5416182e50742ac05d4a3b3a3bb19907e65c0fbb04d683460
May 26 23:46:54.993902 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:54.993757    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:46:55.528413 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:55.527548    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c" exitCode=0
May 26 23:46:55.528413 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:55.527690    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"}
May 26 23:46:55.528413 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:55.527721    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"c6c7969347aaeae5416182e50742ac05d4a3b3a3bb19907e65c0fbb04d683460"}
May 26 23:46:55.530726 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:55.530545    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgsgb" event={"ID":"88a29149-3c3d-4fe9-bb08-e17eeb0c123f","Type":"ContainerStarted","Data":"7de9bf6392ed1144fe114a0cf463c0f602283b57fdf46cd3d03429b04b33d6fd"}
May 26 23:46:55.544698 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:55.544673    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-pfqj9"
May 26 23:46:59.275890 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:59.275858    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:46:59.281448 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:46:59.281419    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:47:00.553396 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.553340    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"}
May 26 23:47:00.553972 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.553947    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"}
May 26 23:47:00.556276 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.556234    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txvg5" event={"ID":"5a247352-647d-4a30-aa69-cc2371cf3fc6","Type":"ContainerStarted","Data":"9108ed7f9b7e0fc84f4402fa08a183aca0537f24230a645f0a1c97422ada3e4d"}
May 26 23:47:00.561031 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.560918    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"}
May 26 23:47:00.561031 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.560951    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"}
May 26 23:47:00.561031 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.560966    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"}
May 26 23:47:00.561031 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.560981    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"}
May 26 23:47:00.564075 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.563355    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgsgb" event={"ID":"88a29149-3c3d-4fe9-bb08-e17eeb0c123f","Type":"ContainerStarted","Data":"bcd3720656a45577b519427f05a3256a5ca209af794a2ae9b804e931d0ceb94c"}
May 26 23:47:00.564075 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.563398    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kgsgb" event={"ID":"88a29149-3c3d-4fe9-bb08-e17eeb0c123f","Type":"ContainerStarted","Data":"063d88576e1b7426104ca3008c39f0d8c570e673b8298773fc8df63b8147a25a"}
May 26 23:47:00.564075 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.564024    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kgsgb"
May 26 23:47:00.577283 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.577228    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-txvg5" podStartSLOduration=137.424412213 podStartE2EDuration="2m21.577210177s" podCreationTimestamp="2026-05-26 23:44:39 +0000 UTC" firstStartedPulling="2026-05-26 23:46:54.418043832 +0000 UTC m=+169.021289954" lastFinishedPulling="2026-05-26 23:46:58.570841793 +0000 UTC m=+173.174087918" observedRunningTime="2026-05-26 23:47:00.573763828 +0000 UTC m=+175.177009985" watchObservedRunningTime="2026-05-26 23:47:00.577210177 +0000 UTC m=+175.180456324"
May 26 23:47:00.595655 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:00.595602    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kgsgb" podStartSLOduration=137.64848975 podStartE2EDuration="2m21.595583267s" podCreationTimestamp="2026-05-26 23:44:39 +0000 UTC" firstStartedPulling="2026-05-26 23:46:54.628310013 +0000 UTC m=+169.231556134" lastFinishedPulling="2026-05-26 23:46:58.575403521 +0000 UTC m=+173.178649651" observedRunningTime="2026-05-26 23:47:00.594037386 +0000 UTC m=+175.197283531" watchObservedRunningTime="2026-05-26 23:47:00.595583267 +0000 UTC m=+175.198829413"
May 26 23:47:01.575439 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:01.575327    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"}
May 26 23:47:03.585313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:03.585267    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"}
May 26 23:47:03.585695 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:03.585317    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"}
May 26 23:47:03.588421 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:03.588396    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerStarted","Data":"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"}
May 26 23:47:03.619552 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:03.619494    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.921637153 podStartE2EDuration="18.619473553s" podCreationTimestamp="2026-05-26 23:46:45 +0000 UTC" firstStartedPulling="2026-05-26 23:46:46.141515301 +0000 UTC m=+160.744761427" lastFinishedPulling="2026-05-26 23:47:02.839351702 +0000 UTC m=+177.442597827" observedRunningTime="2026-05-26 23:47:03.617699891 +0000 UTC m=+178.220946035" watchObservedRunningTime="2026-05-26 23:47:03.619473553 +0000 UTC m=+178.222719704"
May 26 23:47:04.121833 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:04.121799    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:47:04.598771 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:04.598732    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"}
May 26 23:47:04.598771 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:04.598772    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerStarted","Data":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"}
May 26 23:47:04.625331 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:04.625278    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.915654988 podStartE2EDuration="14.6252634s" podCreationTimestamp="2026-05-26 23:46:50 +0000 UTC" firstStartedPulling="2026-05-26 23:46:55.530230239 +0000 UTC m=+170.133476362" lastFinishedPulling="2026-05-26 23:47:03.239838652 +0000 UTC m=+177.843084774" observedRunningTime="2026-05-26 23:47:04.623410192 +0000 UTC m=+179.226656337" watchObservedRunningTime="2026-05-26 23:47:04.6252634 +0000 UTC m=+179.228509543"
May 26 23:47:06.167209 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:06.167172    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:47:11.581923 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:11.581888    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kgsgb"
May 26 23:47:17.979486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:17.979413    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76488b9466-n4v9m" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" containerName="console" containerID="cri-o://2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d" gracePeriod=15
May 26 23:47:18.238838 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.238785    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76488b9466-n4v9m_cf4f9389-690c-415b-a3de-9426744d8e83/console/0.log"
May 26 23:47:18.238947 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.238874    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:47:18.383001 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.382960    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383191 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383031    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383191 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383060    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383191 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383090    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f8ph\" (UniqueName: \"kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383191 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383136    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383191 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383181    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca\") pod \"cf4f9389-690c-415b-a3de-9426744d8e83\" (UID: \"cf4f9389-690c-415b-a3de-9426744d8e83\") "
May 26 23:47:18.383510 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383483    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config" (OuterVolumeSpecName: "console-config") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:18.383577 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383554    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:18.383646 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.383619    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:18.385272 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.385239    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:47:18.385272 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.385264    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:47:18.385450 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.385323    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph" (OuterVolumeSpecName: "kube-api-access-9f8ph") pod "cf4f9389-690c-415b-a3de-9426744d8e83" (UID: "cf4f9389-690c-415b-a3de-9426744d8e83"). InnerVolumeSpecName "kube-api-access-9f8ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:47:18.484306 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484272    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-serving-cert\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.484306 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484302    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-service-ca\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.484306 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484312    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-console-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.484549 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484320    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf4f9389-690c-415b-a3de-9426744d8e83-console-oauth-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.484549 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484329    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf4f9389-690c-415b-a3de-9426744d8e83-oauth-serving-cert\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.484549 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.484338    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f8ph\" (UniqueName: \"kubernetes.io/projected/cf4f9389-690c-415b-a3de-9426744d8e83-kube-api-access-9f8ph\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:18.648792 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76488b9466-n4v9m_cf4f9389-690c-415b-a3de-9426744d8e83/console/0.log"
May 26 23:47:18.648964 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648805    2576 generic.go:358] "Generic (PLEG): container finished" podID="cf4f9389-690c-415b-a3de-9426744d8e83" containerID="2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d" exitCode=2
May 26 23:47:18.648964 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648840    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76488b9466-n4v9m" event={"ID":"cf4f9389-690c-415b-a3de-9426744d8e83","Type":"ContainerDied","Data":"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"}
May 26 23:47:18.648964 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648869    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76488b9466-n4v9m"
May 26 23:47:18.648964 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648881    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76488b9466-n4v9m" event={"ID":"cf4f9389-690c-415b-a3de-9426744d8e83","Type":"ContainerDied","Data":"d9ff86f502c38cd6bd3b5161555433dd8e15a3a38bf3017e5ef66d1faf3a8960"}
May 26 23:47:18.648964 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.648899    2576 scope.go:117] "RemoveContainer" containerID="2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"
May 26 23:47:18.665335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.665320    2576 scope.go:117] "RemoveContainer" containerID="2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"
May 26 23:47:18.665597 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:47:18.665580    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d\": container with ID starting with 2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d not found: ID does not exist" containerID="2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"
May 26 23:47:18.665679 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.665603    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d"} err="failed to get container status \"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d\": rpc error: code = NotFound desc = could not find container \"2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d\": container with ID starting with 2ce4ce096e376fb4a682071408aea524e971266962b0945fe27165e8c57e433d not found: ID does not exist"
May 26 23:47:18.669870 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.669848    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:47:18.673622 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:18.673595    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76488b9466-n4v9m"]
May 26 23:47:19.997384 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:19.997337    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" path="/var/lib/kubelet/pods/cf4f9389-690c-415b-a3de-9426744d8e83/volumes"
May 26 23:47:27.676327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:27.676294    2576 generic.go:358] "Generic (PLEG): container finished" podID="a61198ab-e53a-4640-8f8f-79c2532e96c3" containerID="b77e399fcb9a37d5d727a7236773a50c5c57c8c703c9614214ccce65bcccf354" exitCode=0
May 26 23:47:27.676758 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:27.676395    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks" event={"ID":"a61198ab-e53a-4640-8f8f-79c2532e96c3","Type":"ContainerDied","Data":"b77e399fcb9a37d5d727a7236773a50c5c57c8c703c9614214ccce65bcccf354"}
May 26 23:47:27.676758 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:27.676741    2576 scope.go:117] "RemoveContainer" containerID="b77e399fcb9a37d5d727a7236773a50c5c57c8c703c9614214ccce65bcccf354"
May 26 23:47:28.681418 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:28.681385    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-fh6ks" event={"ID":"a61198ab-e53a-4640-8f8f-79c2532e96c3","Type":"ContainerStarted","Data":"d29a5f136e449857ed04d9031932172c8796bc46a8c1cf9b56a9280664e59348"}
May 26 23:47:29.145147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.145107    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84dfff84ff-7p4fx" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console" containerID="cri-o://8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04" gracePeriod=15
May 26 23:47:29.277626 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.277597    2576 patch_prober.go:28] interesting pod/console-84dfff84ff-7p4fx container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
May 26 23:47:29.277695 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.277661    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-84dfff84ff-7p4fx" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
May 26 23:47:29.405508 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.405455    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84dfff84ff-7p4fx_75e45027-db43-466e-9565-48f278762bdf/console/0.log"
May 26 23:47:29.405617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.405512    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:47:29.577622 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577585    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.577794 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577668    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x6b8\" (UniqueName: \"kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.577794 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577765    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.577907 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577801    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.577907 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577844    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.577907 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577879    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.578050 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.577913    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert\") pod \"75e45027-db43-466e-9565-48f278762bdf\" (UID: \"75e45027-db43-466e-9565-48f278762bdf\") "
May 26 23:47:29.578265 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578240    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca" (OuterVolumeSpecName: "service-ca") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:29.578265 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578247    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config" (OuterVolumeSpecName: "console-config") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:29.578411 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578308    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:29.578411 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578332    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:47:29.578586 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578568    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-console-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.578627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578594    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-service-ca\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.578627 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578608    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-oauth-serving-cert\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.578683 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.578626    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75e45027-db43-466e-9565-48f278762bdf-trusted-ca-bundle\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.580068 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.580030    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:47:29.580068 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.580048    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8" (OuterVolumeSpecName: "kube-api-access-2x6b8") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "kube-api-access-2x6b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:47:29.580068 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.580047    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75e45027-db43-466e-9565-48f278762bdf" (UID: "75e45027-db43-466e-9565-48f278762bdf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:47:29.679660 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.679575    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-serving-cert\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.679660 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.679605    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75e45027-db43-466e-9565-48f278762bdf-console-oauth-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.679660 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.679616    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6b8\" (UniqueName: \"kubernetes.io/projected/75e45027-db43-466e-9565-48f278762bdf-kube-api-access-2x6b8\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:47:29.685737 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685713    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84dfff84ff-7p4fx_75e45027-db43-466e-9565-48f278762bdf/console/0.log"
May 26 23:47:29.686147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685758    2576 generic.go:358] "Generic (PLEG): container finished" podID="75e45027-db43-466e-9565-48f278762bdf" containerID="8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04" exitCode=2
May 26 23:47:29.686147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685806    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfff84ff-7p4fx" event={"ID":"75e45027-db43-466e-9565-48f278762bdf","Type":"ContainerDied","Data":"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"}
May 26 23:47:29.686147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685817    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84dfff84ff-7p4fx"
May 26 23:47:29.686147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685841    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84dfff84ff-7p4fx" event={"ID":"75e45027-db43-466e-9565-48f278762bdf","Type":"ContainerDied","Data":"9bda925a73e5639a6a1bf556199338e91da3cbf371c0f6a047030cffa38e9f8e"}
May 26 23:47:29.686147 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.685866    2576 scope.go:117] "RemoveContainer" containerID="8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"
May 26 23:47:29.694227 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.694210    2576 scope.go:117] "RemoveContainer" containerID="8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"
May 26 23:47:29.694509 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:47:29.694490    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04\": container with ID starting with 8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04 not found: ID does not exist" containerID="8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"
May 26 23:47:29.694571 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.694517    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04"} err="failed to get container status \"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04\": rpc error: code = NotFound desc = could not find container \"8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04\": container with ID starting with 8da4a0b0abcdac69cbcbc114c330c32f8ab3131df6cf749f3d7c877a31255e04 not found: ID does not exist"
May 26 23:47:29.705747 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.705718    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:47:29.708980 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.708961    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84dfff84ff-7p4fx"]
May 26 23:47:29.997041 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:29.996968    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e45027-db43-466e-9565-48f278762bdf" path="/var/lib/kubelet/pods/75e45027-db43-466e-9565-48f278762bdf/volumes"
May 26 23:47:31.693393 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:31.693346    2576 generic.go:358] "Generic (PLEG): container finished" podID="73c2c27c-8a3f-41b0-9b79-ca909459510f" containerID="0dd0eaf14734b09e7b61660ec0c36f849547e4253e2018ddd2e4740cdfc11192" exitCode=0
May 26 23:47:31.693757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:31.693421    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9" event={"ID":"73c2c27c-8a3f-41b0-9b79-ca909459510f","Type":"ContainerDied","Data":"0dd0eaf14734b09e7b61660ec0c36f849547e4253e2018ddd2e4740cdfc11192"}
May 26 23:47:31.693757 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:31.693704    2576 scope.go:117] "RemoveContainer" containerID="0dd0eaf14734b09e7b61660ec0c36f849547e4253e2018ddd2e4740cdfc11192"
May 26 23:47:32.697551 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:32.697519    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sn6r9" event={"ID":"73c2c27c-8a3f-41b0-9b79-ca909459510f","Type":"ContainerStarted","Data":"04d39a1349632224a4ab25f9cad70afebd07cd6a7e095b2a9050553cd15afc6a"}
May 26 23:47:51.166998 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:51.166947    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:47:51.182422 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:51.182394    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:47:51.767202 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:47:51.767177    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:04.830555 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.830521    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.830923    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="alertmanager" containerID="cri-o://64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13" gracePeriod=120
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.831004    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-metric" containerID="cri-o://5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3" gracePeriod=120
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.831048    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="config-reloader" containerID="cri-o://9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97" gracePeriod=120
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.831056    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="prom-label-proxy" containerID="cri-o://1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef" gracePeriod=120
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.831048    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy" containerID="cri-o://a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb" gracePeriod=120
May 26 23:48:04.831179 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:04.831013    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-web" containerID="cri-o://1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432" gracePeriod=120
May 26 23:48:05.797631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797601    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef" exitCode=0
May 26 23:48:05.797631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797626    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb" exitCode=0
May 26 23:48:05.797631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797633    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97" exitCode=0
May 26 23:48:05.797631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797638    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13" exitCode=0
May 26 23:48:05.797950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797677    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"}
May 26 23:48:05.797950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797706    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"}
May 26 23:48:05.797950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797716    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"}
May 26 23:48:05.797950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:05.797724    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"}
May 26 23:48:06.082115 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.082090    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.189460 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189432    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189472    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189509    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189537    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189565    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189587    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189624    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcqn7\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189652    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189689    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189744    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189796    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189804    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189832    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189844    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:06.189963 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.189868    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle\") pod \"54bedb62-6166-40c0-b080-e642466f70d9\" (UID: \"54bedb62-6166-40c0-b080-e642466f70d9\") "
May 26 23:48:06.190321 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.190129    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-main-db\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.190321 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.190148    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-metrics-client-ca\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.190620 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.190556    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:06.193067 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193031    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.193186 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193067    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:48:06.193186 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193103    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.193419 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193394    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.193518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193418    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.193518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193467    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume" (OuterVolumeSpecName: "config-volume") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.193740 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.193713    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7" (OuterVolumeSpecName: "kube-api-access-dcqn7") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "kube-api-access-dcqn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:48:06.194118 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.194088    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out" (OuterVolumeSpecName: "config-out") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 23:48:06.198120 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.198094    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.203826 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.203807    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config" (OuterVolumeSpecName: "web-config") pod "54bedb62-6166-40c0-b080-e642466f70d9" (UID: "54bedb62-6166-40c0-b080-e642466f70d9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:06.291100 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291065    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-tls-assets\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291100 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291096    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-main-tls\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291100 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291107    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcqn7\" (UniqueName: \"kubernetes.io/projected/54bedb62-6166-40c0-b080-e642466f70d9-kube-api-access-dcqn7\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291117    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291128    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291138    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-cluster-tls-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291147    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54bedb62-6166-40c0-b080-e642466f70d9-config-out\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291155    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-config-volume\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291163    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54bedb62-6166-40c0-b080-e642466f70d9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291172    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.291313 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.291181    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54bedb62-6166-40c0-b080-e642466f70d9-web-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:06.803729 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803699    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3" exitCode=0
May 26 23:48:06.803729 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803723    2576 generic.go:358] "Generic (PLEG): container finished" podID="54bedb62-6166-40c0-b080-e642466f70d9" containerID="1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432" exitCode=0
May 26 23:48:06.803950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803798    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.803950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803791    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"}
May 26 23:48:06.803950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803920    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"}
May 26 23:48:06.803950 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803939    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54bedb62-6166-40c0-b080-e642466f70d9","Type":"ContainerDied","Data":"29b1ddb7045798439ce69e5c2b084c6ffbd0de843e0c5beeee39057df83bb740"}
May 26 23:48:06.804125 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.803963    2576 scope.go:117] "RemoveContainer" containerID="1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"
May 26 23:48:06.811557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.811530    2576 scope.go:117] "RemoveContainer" containerID="5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"
May 26 23:48:06.818603 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.818585    2576 scope.go:117] "RemoveContainer" containerID="a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"
May 26 23:48:06.825039 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.825016    2576 scope.go:117] "RemoveContainer" containerID="1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"
May 26 23:48:06.826968 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.826945    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:06.830449 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.830427    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:06.832022 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.831998    2576 scope.go:117] "RemoveContainer" containerID="9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"
May 26 23:48:06.838271 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.838253    2576 scope.go:117] "RemoveContainer" containerID="64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"
May 26 23:48:06.844448 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.844432    2576 scope.go:117] "RemoveContainer" containerID="a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"
May 26 23:48:06.850961 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.850947    2576 scope.go:117] "RemoveContainer" containerID="1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"
May 26 23:48:06.851195 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.851176    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef\": container with ID starting with 1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef not found: ID does not exist" containerID="1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"
May 26 23:48:06.851237 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851205    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"} err="failed to get container status \"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef\": rpc error: code = NotFound desc = could not find container \"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef\": container with ID starting with 1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef not found: ID does not exist"
May 26 23:48:06.851237 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851229    2576 scope.go:117] "RemoveContainer" containerID="5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"
May 26 23:48:06.851476 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.851456    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3\": container with ID starting with 5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3 not found: ID does not exist" containerID="5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"
May 26 23:48:06.851529 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851485    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"} err="failed to get container status \"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3\": rpc error: code = NotFound desc = could not find container \"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3\": container with ID starting with 5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3 not found: ID does not exist"
May 26 23:48:06.851529 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851505    2576 scope.go:117] "RemoveContainer" containerID="a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"
May 26 23:48:06.851733 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.851715    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb\": container with ID starting with a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb not found: ID does not exist" containerID="a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"
May 26 23:48:06.851796 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851741    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"} err="failed to get container status \"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb\": rpc error: code = NotFound desc = could not find container \"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb\": container with ID starting with a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb not found: ID does not exist"
May 26 23:48:06.851796 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851763    2576 scope.go:117] "RemoveContainer" containerID="1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"
May 26 23:48:06.851977 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.851963    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432\": container with ID starting with 1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432 not found: ID does not exist" containerID="1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"
May 26 23:48:06.852033 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.851985    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"} err="failed to get container status \"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432\": rpc error: code = NotFound desc = could not find container \"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432\": container with ID starting with 1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432 not found: ID does not exist"
May 26 23:48:06.852033 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.852004    2576 scope.go:117] "RemoveContainer" containerID="9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"
May 26 23:48:06.852213 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.852198    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97\": container with ID starting with 9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97 not found: ID does not exist" containerID="9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"
May 26 23:48:06.852253 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.852218    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"} err="failed to get container status \"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97\": rpc error: code = NotFound desc = could not find container \"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97\": container with ID starting with 9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97 not found: ID does not exist"
May 26 23:48:06.852253 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.852233    2576 scope.go:117] "RemoveContainer" containerID="64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"
May 26 23:48:06.852788 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.852706    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13\": container with ID starting with 64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13 not found: ID does not exist" containerID="64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"
May 26 23:48:06.852788 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.852779    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"} err="failed to get container status \"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13\": rpc error: code = NotFound desc = could not find container \"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13\": container with ID starting with 64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13 not found: ID does not exist"
May 26 23:48:06.852997 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.852800    2576 scope.go:117] "RemoveContainer" containerID="a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"
May 26 23:48:06.853173 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:06.853055    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893\": container with ID starting with a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893 not found: ID does not exist" containerID="a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"
May 26 23:48:06.853266 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853082    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"} err="failed to get container status \"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893\": rpc error: code = NotFound desc = could not find container \"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893\": container with ID starting with a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893 not found: ID does not exist"
May 26 23:48:06.853266 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853227    2576 scope.go:117] "RemoveContainer" containerID="1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"
May 26 23:48:06.853530 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853507    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef"} err="failed to get container status \"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef\": rpc error: code = NotFound desc = could not find container \"1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef\": container with ID starting with 1bae17e2ba09cdda131bac43e0467a6f2f5bb0de7f54c257ae27adeee32bbaef not found: ID does not exist"
May 26 23:48:06.853590 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853530    2576 scope.go:117] "RemoveContainer" containerID="5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"
May 26 23:48:06.853733 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853718    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3"} err="failed to get container status \"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3\": rpc error: code = NotFound desc = could not find container \"5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3\": container with ID starting with 5e36267c040d007251d77de2e6ede5071f43de0a1f9cf203f3160bab3b8afdc3 not found: ID does not exist"
May 26 23:48:06.853775 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853733    2576 scope.go:117] "RemoveContainer" containerID="a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"
May 26 23:48:06.853949 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853933    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb"} err="failed to get container status \"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb\": rpc error: code = NotFound desc = could not find container \"a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb\": container with ID starting with a955b0136d30e8b18186c432fc825db1608d0e103472f93ea3339976c2c204bb not found: ID does not exist"
May 26 23:48:06.853989 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.853949    2576 scope.go:117] "RemoveContainer" containerID="1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"
May 26 23:48:06.854139 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854125    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432"} err="failed to get container status \"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432\": rpc error: code = NotFound desc = could not find container \"1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432\": container with ID starting with 1497d0474b527be29fbc769dc5b987c6f080aa0fa55a8171da35ed904891a432 not found: ID does not exist"
May 26 23:48:06.854139 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854138    2576 scope.go:117] "RemoveContainer" containerID="9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"
May 26 23:48:06.854338 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854323    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97"} err="failed to get container status \"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97\": rpc error: code = NotFound desc = could not find container \"9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97\": container with ID starting with 9345b5fd1a17ae0008fc844f07077af2f49e2d28407eac51435883bc40b53f97 not found: ID does not exist"
May 26 23:48:06.854338 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854337    2576 scope.go:117] "RemoveContainer" containerID="64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"
May 26 23:48:06.854557 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854541    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13"} err="failed to get container status \"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13\": rpc error: code = NotFound desc = could not find container \"64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13\": container with ID starting with 64f6c77f8cf3a8be2aabcafcc0b465e43f8871c4816886b665b7a79363589d13 not found: ID does not exist"
May 26 23:48:06.854605 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854558    2576 scope.go:117] "RemoveContainer" containerID="a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"
May 26 23:48:06.854769 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854747    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893"} err="failed to get container status \"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893\": rpc error: code = NotFound desc = could not find container \"a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893\": container with ID starting with a97b0e1e7ab119bee669bda939b0b61635e269870a8f02c76e50d978e388e893 not found: ID does not exist"
May 26 23:48:06.854826 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.854783    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:06.855063 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855051    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-web"
May 26 23:48:06.855097 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855066    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-web"
May 26 23:48:06.855097 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855079    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-metric"
May 26 23:48:06.855097 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855085    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-metric"
May 26 23:48:06.855097 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" containerName="console"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855099    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" containerName="console"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855114    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="alertmanager"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855119    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="alertmanager"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855126    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855131    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855136    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="init-config-reloader"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855142    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="init-config-reloader"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855149    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="prom-label-proxy"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855154    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="prom-label-proxy"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855160    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="config-reloader"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855165    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="config-reloader"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855172    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy"
May 26 23:48:06.855205 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855224    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-metric"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855233    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="prom-label-proxy"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855239    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="alertmanager"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855245    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855251    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="config-reloader"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855260    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="54bedb62-6166-40c0-b080-e642466f70d9" containerName="kube-rbac-proxy-web"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855270    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="75e45027-db43-466e-9565-48f278762bdf" containerName="console"
May 26 23:48:06.855582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.855276    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf4f9389-690c-415b-a3de-9426744d8e83" containerName="console"
May 26 23:48:06.858477 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.858461    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.860688 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860659    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 23:48:06.860772 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860684    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 23:48:06.860772 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860659    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 23:48:06.860772 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860761    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 23:48:06.860936 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860921    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 23:48:06.860936 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.860929    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 23:48:06.861083 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.861068    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 23:48:06.861174 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.861147    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 23:48:06.861248 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.861197    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wwfrc\""
May 26 23:48:06.865419 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.865399    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 23:48:06.870345 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.870324    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:06.996663 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996663 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.996863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.996993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vqv\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-kube-api-access-b4vqv\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:06.997011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:06.997009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097429 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097314    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097429 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097386    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097439    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097465    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097496    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097529    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097557    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097597    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097640    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097680    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097729    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097753    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vqv\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-kube-api-access-b4vqv\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.097924 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.097777    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.098477 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.098187    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.098477 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.098349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.098827 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.098802    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8447f508-153a-4623-9b34-a068a5b6e2c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.100609 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.100585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.100724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.100611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.100724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.100654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.100724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.100654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.100724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.100703    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8447f508-153a-4623-9b34-a068a5b6e2c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.101206 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.101186    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.101293 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.101265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.101810 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.101787    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.102532 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.102518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8447f508-153a-4623-9b34-a068a5b6e2c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.108307 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.108288    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vqv\" (UniqueName: \"kubernetes.io/projected/8447f508-153a-4623-9b34-a068a5b6e2c2-kube-api-access-b4vqv\") pod \"alertmanager-main-0\" (UID: \"8447f508-153a-4623-9b34-a068a5b6e2c2\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.167738 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.167716    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 23:48:07.294435 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.294409    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 23:48:07.296974 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:48:07.296944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8447f508_153a_4623_9b34_a068a5b6e2c2.slice/crio-d9be4f8013d7f0d4393a6d645bde57855dce0307f4de2afac60cb0ca4f5cbf95 WatchSource:0}: Error finding container d9be4f8013d7f0d4393a6d645bde57855dce0307f4de2afac60cb0ca4f5cbf95: Status 404 returned error can't find the container with id d9be4f8013d7f0d4393a6d645bde57855dce0307f4de2afac60cb0ca4f5cbf95
May 26 23:48:07.808174 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.808141    2576 generic.go:358] "Generic (PLEG): container finished" podID="8447f508-153a-4623-9b34-a068a5b6e2c2" containerID="68f8655980b393e13f9eac99a8a667caeeceb9de373beb0dd4773770be803069" exitCode=0
May 26 23:48:07.808343 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.808225    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerDied","Data":"68f8655980b393e13f9eac99a8a667caeeceb9de373beb0dd4773770be803069"}
May 26 23:48:07.808343 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.808262    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"d9be4f8013d7f0d4393a6d645bde57855dce0307f4de2afac60cb0ca4f5cbf95"}
May 26 23:48:07.997831 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:07.997800    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54bedb62-6166-40c0-b080-e642466f70d9" path="/var/lib/kubelet/pods/54bedb62-6166-40c0-b080-e642466f70d9/volumes"
May 26 23:48:08.815356 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815322    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"bd3395f6a25dc2d26be5645f59e4b76df4d686f95b62c2a66641d2a8385a2ee9"}
May 26 23:48:08.815731 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815383    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"c957ccd9bb2fdadd1613be4831b375feec67b0a1f8559a455ba1a0d8473b83fa"}
May 26 23:48:08.815731 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815400    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"a7b305eb4f975c440c3461c36226747b27bb847694a531ab4fbeb0fc9ab285c2"}
May 26 23:48:08.815731 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815415    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"7834d242beb9ed8a5dd2ec2db5223f69e624898c76429c9d4cf2183d3a9808c0"}
May 26 23:48:08.815731 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815429    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"c6009897e1ecb3cddd628cd6a122ae28abd49cd29fce7e9a613ffe3ec6cf98d1"}
May 26 23:48:08.815731 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.815441    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8447f508-153a-4623-9b34-a068a5b6e2c2","Type":"ContainerStarted","Data":"e8ce1fadf7c24c034cb5215992e504d8d3f0505d55c3448dee3fc4498c1bb0b2"}
May 26 23:48:08.859693 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.859642    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.859627176 podStartE2EDuration="2.859627176s" podCreationTimestamp="2026-05-26 23:48:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:48:08.857210379 +0000 UTC m=+243.460456525" watchObservedRunningTime="2026-05-26 23:48:08.859627176 +0000 UTC m=+243.462873319"
May 26 23:48:08.860975 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.860960    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677969cd7b-tnhdc"]
May 26 23:48:08.863317 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.863296    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:08.865886 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.865865    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 23:48:08.866537 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.866524    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 23:48:08.866800 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.866787    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 23:48:08.867046 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.867026    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 23:48:08.867278 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.867255    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wk2h9\""
May 26 23:48:08.867395 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.867313    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 23:48:08.872509 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.872490    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 23:48:08.897486 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:08.897451    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677969cd7b-tnhdc"]
May 26 23:48:09.012884 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.012845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013058 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.012890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-metrics-client-ca\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013058 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.012990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g9bt\" (UniqueName: \"kubernetes.io/projected/a715d264-3b92-4bca-b242-10f4b736b609-kube-api-access-9g9bt\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013058 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.013030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013178 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.013065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-serving-certs-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013178 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.013082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013178 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.013105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.013178 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.013163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-federate-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114629 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114541    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114629 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114603    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-federate-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114638    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114672    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-metrics-client-ca\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114714    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g9bt\" (UniqueName: \"kubernetes.io/projected/a715d264-3b92-4bca-b242-10f4b736b609-kube-api-access-9g9bt\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114745    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114785    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-serving-certs-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.114823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.114808    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.115479 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.115451    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-serving-certs-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.115581 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.115501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-metrics-client-ca\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.115581 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.115549    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.117415 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.117388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.117513 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.117422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-federate-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.117708 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.117688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-secret-telemeter-client\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.117762 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.117692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a715d264-3b92-4bca-b242-10f4b736b609-telemeter-client-tls\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.121829 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.121807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g9bt\" (UniqueName: \"kubernetes.io/projected/a715d264-3b92-4bca-b242-10f4b736b609-kube-api-access-9g9bt\") pod \"telemeter-client-677969cd7b-tnhdc\" (UID: \"a715d264-3b92-4bca-b242-10f4b736b609\") " pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.161639 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.161611    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:09.162029 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.161995    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="prometheus" containerID="cri-o://6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef" gracePeriod=600
May 26 23:48:09.162164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.162037    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="thanos-sidecar" containerID="cri-o://1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08" gracePeriod=600
May 26 23:48:09.162164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.162063    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="config-reloader" containerID="cri-o://023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a" gracePeriod=600
May 26 23:48:09.162164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.162069    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5" gracePeriod=600
May 26 23:48:09.162164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.162024    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy" containerID="cri-o://4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644" gracePeriod=600
May 26 23:48:09.162164 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.162067    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-web" containerID="cri-o://cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def" gracePeriod=600
May 26 23:48:09.172896 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.172873    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc"
May 26 23:48:09.317982 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.317943    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677969cd7b-tnhdc"]
May 26 23:48:09.321406 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:48:09.321377    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda715d264_3b92_4bca_b242_10f4b736b609.slice/crio-430657fea2159a255319300665d95d78e0d47174ccda65987457bd8bf7438da5 WatchSource:0}: Error finding container 430657fea2159a255319300665d95d78e0d47174ccda65987457bd8bf7438da5: Status 404 returned error can't find the container with id 430657fea2159a255319300665d95d78e0d47174ccda65987457bd8bf7438da5
May 26 23:48:09.397623 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.397599    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:09.518426 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518360    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518444    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9gdt\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518483    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518503    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518528    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518547    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518585 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518563    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518592    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518634    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518670    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518698    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518740    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518772    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518800    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518835    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518860    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.518894 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518895    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.519445 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518927    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out\") pod \"05c5a430-deb7-4bba-b590-93b971efbbbc\" (UID: \"05c5a430-deb7-4bba-b590-93b971efbbbc\") "
May 26 23:48:09.519445 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.518984    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:09.519445 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.519239    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-metrics-client-ca\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.519882 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.519676    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:09.520591 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.520561    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:09.520818 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.520793    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:09.521190 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.521163    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 23:48:09.521476 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.521448    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.521476 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.521469    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 23:48:09.522310 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522212    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt" (OuterVolumeSpecName: "kube-api-access-n9gdt") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "kube-api-access-n9gdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:48:09.522310 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522280    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out" (OuterVolumeSpecName: "config-out") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 23:48:09.522490 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522337    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.522640 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522608    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.522790 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522751    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.522858 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522836    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 23:48:09.522984 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.522969    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.523415 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.523396    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.523563 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.523546    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config" (OuterVolumeSpecName: "config") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.523606 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.523559    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.533167 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.533148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config" (OuterVolumeSpecName: "web-config") pod "05c5a430-deb7-4bba-b590-93b971efbbbc" (UID: "05c5a430-deb7-4bba-b590-93b971efbbbc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 23:48:09.619724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619691    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-web-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619724 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619720    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619739    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619755    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619767    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619779    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-tls-assets\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619792    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-grpc-tls\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619804    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619826    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619839    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-config\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619852    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05c5a430-deb7-4bba-b590-93b971efbbbc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619867    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-kube-rbac-proxy\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619879    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-prometheus-k8s-db\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619891    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-metrics-client-certs\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619903    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/05c5a430-deb7-4bba-b590-93b971efbbbc-config-out\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619917    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/05c5a430-deb7-4bba-b590-93b971efbbbc-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.619959 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.619931    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9gdt\" (UniqueName: \"kubernetes.io/projected/05c5a430-deb7-4bba-b590-93b971efbbbc-kube-api-access-n9gdt\") on node \"ip-10-0-128-145.ec2.internal\" DevicePath \"\""
May 26 23:48:09.820921 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820885    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5" exitCode=0
May 26 23:48:09.820921 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820911    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644" exitCode=0
May 26 23:48:09.820921 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820918    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def" exitCode=0
May 26 23:48:09.820921 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820926    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08" exitCode=0
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820932    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a" exitCode=0
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820938    2576 generic.go:358] "Generic (PLEG): container finished" podID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef" exitCode=0
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.820981    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821026    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821030    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821044    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821064    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821080    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821093    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821108    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"05c5a430-deb7-4bba-b590-93b971efbbbc","Type":"ContainerDied","Data":"c6c7969347aaeae5416182e50742ac05d4a3b3a3bb19907e65c0fbb04d683460"}
May 26 23:48:09.821575 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.821127    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.822708 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.822681    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc" event={"ID":"a715d264-3b92-4bca-b242-10f4b736b609","Type":"ContainerStarted","Data":"430657fea2159a255319300665d95d78e0d47174ccda65987457bd8bf7438da5"}
May 26 23:48:09.828751 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.828715    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.839295 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.839271    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.847276 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.847253    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.847431 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.847411    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:09.850145 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.850120    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:09.854547 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.854527    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.860975 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.860951    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.868512 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.868490    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.875455 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.875435    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.875739 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.875716    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.875842 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.875747    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.875842 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.875769    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.876126 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.876091    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.876225 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876130    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.876225 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876156    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.876423 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.876403    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.876504 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876427    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.876504 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876443    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.876699 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.876682    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.876759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876705    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.876759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.876725    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.877004 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.876983    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.877039 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877011    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.877039 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877030    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.877455 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.877410    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.877555 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877461    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.877555 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877482    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.877888 ip-10-0-128-145 kubenswrapper[2576]: E0526 23:48:09.877859    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.877982 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.877982 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.877914    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.878245 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.878207    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.878245 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.878233    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.878635 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.878573    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.878635 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.878598    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.878998 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.878969    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.879082 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879007    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.879401 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879355    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.879401 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879398    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.879654 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879616    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.879728 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879656    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.879875 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.879940 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.879875    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.880153 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880124    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.880229 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880153    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.880428 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880409    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.880515 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880429    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.880728 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880702    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.880809 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880731    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.880947 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.880927    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:09.881265 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881241    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.881338 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881267    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.881432 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881418    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="init-config-reloader"
May 26 23:48:09.881488 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881433    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="init-config-reloader"
May 26 23:48:09.881488 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881445    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="prometheus"
May 26 23:48:09.881488 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881453    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="prometheus"
May 26 23:48:09.881488 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881466    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy"
May 26 23:48:09.881488 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881475    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881490    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="config-reloader"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881499    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="config-reloader"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881511    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-web"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881519    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-web"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881525    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-thanos"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881530    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-thanos"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881542    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="thanos-sidecar"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881550    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="thanos-sidecar"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881599    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="prometheus"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881607    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="thanos-sidecar"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881613    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="config-reloader"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881538    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881634    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881622    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881699    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-web"
May 26 23:48:09.881723 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881716    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" containerName="kube-rbac-proxy-thanos"
May 26 23:48:09.882354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881892    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.882354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.881914    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.882354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882207    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.882354 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882241    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.882535 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882481    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.882535 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882502    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.882876 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882851    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.882967 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.882877    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.883168 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883122    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.883168 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883161    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.883397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.883397 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883396    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.883563 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883542    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.883617 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883566    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.883820 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883792    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.883820 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.883818    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.884053 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884032    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.884121 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884055    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.884350 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.884350 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884345    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.884579 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884562    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.884631 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884580    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.884802 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884785    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.884856 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884802    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.885005 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.884984    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.885067 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885006    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.885245 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885210    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.885335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885246    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.885335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885317    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:09.885508 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885481    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.885628 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.885512    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.886162 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886140    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.886264 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886164    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.886420 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886399    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.886493 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886421    2576 scope.go:117] "RemoveContainer" containerID="24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"
May 26 23:48:09.886823 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886803    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5"} err="failed to get container status \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": rpc error: code = NotFound desc = could not find container \"24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5\": container with ID starting with 24244f8bbc1583e92dca10b4faa28d9a0f437e5127eeafe678db2b0ab343d3c5 not found: ID does not exist"
May 26 23:48:09.886902 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.886824    2576 scope.go:117] "RemoveContainer" containerID="4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"
May 26 23:48:09.887082 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887057    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644"} err="failed to get container status \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": rpc error: code = NotFound desc = could not find container \"4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644\": container with ID starting with 4cd527597d87cd3808788100bbb8e09e1cd85e411789ec1687b5395e866b2644 not found: ID does not exist"
May 26 23:48:09.887152 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887085    2576 scope.go:117] "RemoveContainer" containerID="cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"
May 26 23:48:09.887401 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887328    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def"} err="failed to get container status \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": rpc error: code = NotFound desc = could not find container \"cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def\": container with ID starting with cfc3e94f6bf2e09fb78a3d5085f57b3168a99e642be894127dcfc6c5e4518def not found: ID does not exist"
May 26 23:48:09.887401 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887356    2576 scope.go:117] "RemoveContainer" containerID="1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"
May 26 23:48:09.887647 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887616    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08"} err="failed to get container status \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": rpc error: code = NotFound desc = could not find container \"1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08\": container with ID starting with 1abc1385354c369a0b60b403f19dc2c55432e39a44b0cd3c59d7142fa64c1c08 not found: ID does not exist"
May 26 23:48:09.887647 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887645    2576 scope.go:117] "RemoveContainer" containerID="023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"
May 26 23:48:09.887806 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887686    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 23:48:09.887863 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887839    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 23:48:09.887928 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887903    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a"} err="failed to get container status \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": rpc error: code = NotFound desc = could not find container \"023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a\": container with ID starting with 023942a34d8f9a1d6915f2499ce852fc018e5a119882c99c0f2866696354592a not found: ID does not exist"
May 26 23:48:09.887984 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887931    2576 scope.go:117] "RemoveContainer" containerID="6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"
May 26 23:48:09.887984 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.887950    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 23:48:09.888124 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888106    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bxz7k\""
May 26 23:48:09.888208 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888136    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 23:48:09.888274 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888242    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cr28qdvp3ml8k\""
May 26 23:48:09.888332 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888295    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 23:48:09.888421 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888399    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef"} err="failed to get container status \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": rpc error: code = NotFound desc = could not find container \"6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef\": container with ID starting with 6da9810fa85d45f66d60d3fd206905c2fdf70f775fe6bc759c70b1cdb4f00bef not found: ID does not exist"
May 26 23:48:09.888494 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888424    2576 scope.go:117] "RemoveContainer" containerID="58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"
May 26 23:48:09.888693 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888661    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 23:48:09.888693 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888697    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 23:48:09.888841 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888729    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 23:48:09.888841 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888809    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c"} err="failed to get container status \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": rpc error: code = NotFound desc = could not find container \"58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c\": container with ID starting with 58a42c67d4423f2b14f8c378192274eb6665ee4bbdab4e64dde4f56f998c136c not found: ID does not exist"
May 26 23:48:09.888952 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888877    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 23:48:09.889009 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888952    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 23:48:09.889009 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.888954    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 23:48:09.891340 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.891321    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 23:48:09.893825 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.893795    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 23:48:09.898675 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.898655    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:09.997672 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:09.997642    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c5a430-deb7-4bba-b590-93b971efbbbc" path="/var/lib/kubelet/pods/05c5a430-deb7-4bba-b590-93b971efbbbc/volumes"
May 26 23:48:10.023769 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.023922 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.023922 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.023922 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024056 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024056 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.023985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024056 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024168 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024168 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024168 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpz44\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-kube-api-access-dpz44\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024307 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024307 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024307 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024480 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.024630 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.024500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.125878 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.125842    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126023 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.125890    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126023 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.125914    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126142 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126125    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126215 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126192    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126275 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126236    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126329 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126289    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126405 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126383    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126456 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126445    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126507 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126475    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126564 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126524    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126564 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126554    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz44\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-kube-api-access-dpz44\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126660 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126623    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126713 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126682    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126774 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126718    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126774 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126763    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126927 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126810    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.126927 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126855    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.127023 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.126984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.127452 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.127431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.128216 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.127918    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.130103 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.130075    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.130220 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.130200    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.130816 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.130617    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131078 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.130838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131078 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131078 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131335 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131280    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a294b45-d599-4068-bca4-099188ed74b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131524 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131504    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131524 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.131855 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.131829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a294b45-d599-4068-bca4-099188ed74b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.132801 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.132742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.133183 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.133166    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-config\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.133258 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.133195    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.133258 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.133225    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a294b45-d599-4068-bca4-099188ed74b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.137316 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.137297    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpz44\" (UniqueName: \"kubernetes.io/projected/6a294b45-d599-4068-bca4-099188ed74b5-kube-api-access-dpz44\") pod \"prometheus-k8s-0\" (UID: \"6a294b45-d599-4068-bca4-099188ed74b5\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.197481 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.197429    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:10.347006 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.346982    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 23:48:10.350083 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:48:10.350058    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a294b45_d599_4068_bca4_099188ed74b5.slice/crio-5a35b841ab2cc667f217c9064aecc406a9221053a518d54e36fb654835a44f17 WatchSource:0}: Error finding container 5a35b841ab2cc667f217c9064aecc406a9221053a518d54e36fb654835a44f17: Status 404 returned error can't find the container with id 5a35b841ab2cc667f217c9064aecc406a9221053a518d54e36fb654835a44f17
May 26 23:48:10.829262 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.829229    2576 generic.go:358] "Generic (PLEG): container finished" podID="6a294b45-d599-4068-bca4-099188ed74b5" containerID="d3914bf6f410771cf507ce92966d954e841f5ec95f0cff5eaa702e653b9c31bc" exitCode=0
May 26 23:48:10.829699 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.829294    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerDied","Data":"d3914bf6f410771cf507ce92966d954e841f5ec95f0cff5eaa702e653b9c31bc"}
May 26 23:48:10.829699 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:10.829319    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"5a35b841ab2cc667f217c9064aecc406a9221053a518d54e36fb654835a44f17"}
May 26 23:48:11.835923 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835887    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"4fd9452b1923dda989acb8f23f4a74707071468a0a24ef72db7acd6453fc83bd"}
May 26 23:48:11.836327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835931    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"8bca55189505ab8027b5e23c0eec8addc9dfedb58094919473583bada6e7629a"}
May 26 23:48:11.836327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835945    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"e75662a164b47f092aea58a72d18e6c0a615ccee8c2f54e1b5de6e753fa6d9c1"}
May 26 23:48:11.836327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835956    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"2aa47c1b37c9b2100c5c57f4bd1492f8b3a8efc9938fbf2a23568005a8d59a6a"}
May 26 23:48:11.836327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835966    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"6632035df56210721bac310486ac697ece3c089e16bc3d4131c62dda1ec5d2e6"}
May 26 23:48:11.836327 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.835979    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a294b45-d599-4068-bca4-099188ed74b5","Type":"ContainerStarted","Data":"6a8d37a727b2efd3a32c5974ad42273c529ad613503d165d0490394ebbf3eba5"}
May 26 23:48:11.837690 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.837668    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc" event={"ID":"a715d264-3b92-4bca-b242-10f4b736b609","Type":"ContainerStarted","Data":"9ea9c12b47028eb910aea028517418bb57d8383ecd86a4563405c0773f225a31"}
May 26 23:48:11.837690 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.837693    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc" event={"ID":"a715d264-3b92-4bca-b242-10f4b736b609","Type":"ContainerStarted","Data":"9a2bd5c657f6fa65b1c268e7f7e6d8e2da7891e565a19e78c57c7797d8d298b2"}
May 26 23:48:11.837826 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.837703    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc" event={"ID":"a715d264-3b92-4bca-b242-10f4b736b609","Type":"ContainerStarted","Data":"4c4c1342ee1e58080cfd811035ccd56b2b944ca3371610d5c819ae5c3855c274"}
May 26 23:48:11.861011 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.860969    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.860958321 podStartE2EDuration="2.860958321s" podCreationTimestamp="2026-05-26 23:48:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:48:11.859727572 +0000 UTC m=+246.462973760" watchObservedRunningTime="2026-05-26 23:48:11.860958321 +0000 UTC m=+246.464204465"
May 26 23:48:11.881265 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:11.881219    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677969cd7b-tnhdc" podStartSLOduration=2.141298444 podStartE2EDuration="3.88120715s" podCreationTimestamp="2026-05-26 23:48:08 +0000 UTC" firstStartedPulling="2026-05-26 23:48:09.323379869 +0000 UTC m=+243.926625994" lastFinishedPulling="2026-05-26 23:48:11.063288574 +0000 UTC m=+245.666534700" observedRunningTime="2026-05-26 23:48:11.880424914 +0000 UTC m=+246.483671061" watchObservedRunningTime="2026-05-26 23:48:11.88120715 +0000 UTC m=+246.484453292"
May 26 23:48:15.197941 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:15.197901    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:48:17.795777 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:17.795681    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:48:17.799274 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:17.799245    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df59971-f956-4ab6-9811-882e6efb9af0-metrics-certs\") pod \"network-metrics-daemon-n984x\" (UID: \"6df59971-f956-4ab6-9811-882e6efb9af0\") " pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:48:18.098052 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:18.097962    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9n4z9\""
May 26 23:48:18.105761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:18.105739    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n984x"
May 26 23:48:18.227842 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:18.227817    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n984x"]
May 26 23:48:18.230502 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:48:18.230476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df59971_f956_4ab6_9811_882e6efb9af0.slice/crio-91ac317aee5ee6c568dad886329ed92a7e83aeff376a47344952ced19a9fff8d WatchSource:0}: Error finding container 91ac317aee5ee6c568dad886329ed92a7e83aeff376a47344952ced19a9fff8d: Status 404 returned error can't find the container with id 91ac317aee5ee6c568dad886329ed92a7e83aeff376a47344952ced19a9fff8d
May 26 23:48:18.861737 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:18.861696    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n984x" event={"ID":"6df59971-f956-4ab6-9811-882e6efb9af0","Type":"ContainerStarted","Data":"91ac317aee5ee6c568dad886329ed92a7e83aeff376a47344952ced19a9fff8d"}
May 26 23:48:19.866679 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:19.866647    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n984x" event={"ID":"6df59971-f956-4ab6-9811-882e6efb9af0","Type":"ContainerStarted","Data":"f98e9877f2228c3f5e2af3793da28fb2211db7426208b7a755d8dbd0988452a9"}
May 26 23:48:19.867029 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:19.866686    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n984x" event={"ID":"6df59971-f956-4ab6-9811-882e6efb9af0","Type":"ContainerStarted","Data":"c96f30e36b6d8c4f37f03312f6223408986ee726f2cc41d5722128a1afd2cd44"}
May 26 23:48:19.883031 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:48:19.882987    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n984x" podStartSLOduration=252.865647635 podStartE2EDuration="4m13.882973304s" podCreationTimestamp="2026-05-26 23:44:06 +0000 UTC" firstStartedPulling="2026-05-26 23:48:18.232417467 +0000 UTC m=+252.835663592" lastFinishedPulling="2026-05-26 23:48:19.249743138 +0000 UTC m=+253.852989261" observedRunningTime="2026-05-26 23:48:19.880957913 +0000 UTC m=+254.484204057" watchObservedRunningTime="2026-05-26 23:48:19.882973304 +0000 UTC m=+254.486219448"
May 26 23:49:05.920266 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:05.920237    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:49:05.920902 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:05.920383    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:49:05.924162 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:05.924144    2576 kubelet.go:1628] "Image garbage collection succeeded"
May 26 23:49:10.197870 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:10.197822    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:49:10.213151 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:10.213124    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:49:11.034588 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:49:11.034558    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 23:50:01.703073 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.702990    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-p84fd"]
May 26 23:50:01.706249 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.706232    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.709165 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.709138    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 23:50:01.717888 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.717862    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p84fd"]
May 26 23:50:01.852857 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.852824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-dbus\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.852857 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.852859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-kubelet-config\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.853063 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.852880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7807e339-39fa-48e5-8bbd-be8dd61a00c4-original-pull-secret\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.953791 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.953701    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-dbus\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.953791 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.953742    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-kubelet-config\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.953972 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.953884    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-dbus\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.953972 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.953906    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7807e339-39fa-48e5-8bbd-be8dd61a00c4-original-pull-secret\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.953972 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.953884    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7807e339-39fa-48e5-8bbd-be8dd61a00c4-kubelet-config\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:01.956100 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:01.956079    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7807e339-39fa-48e5-8bbd-be8dd61a00c4-original-pull-secret\") pod \"global-pull-secret-syncer-p84fd\" (UID: \"7807e339-39fa-48e5-8bbd-be8dd61a00c4\") " pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:02.015128 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:02.015100    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p84fd"
May 26 23:50:02.132035 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:02.132009    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p84fd"]
May 26 23:50:02.134614 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:50:02.134583    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7807e339_39fa_48e5_8bbd_be8dd61a00c4.slice/crio-de5a16952f20d124fbedcdfd8ee8198f3407cbad29e765d1f086b2be9e827179 WatchSource:0}: Error finding container de5a16952f20d124fbedcdfd8ee8198f3407cbad29e765d1f086b2be9e827179: Status 404 returned error can't find the container with id de5a16952f20d124fbedcdfd8ee8198f3407cbad29e765d1f086b2be9e827179
May 26 23:50:02.136583 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:02.136564    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 23:50:02.176395 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:02.176352    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p84fd" event={"ID":"7807e339-39fa-48e5-8bbd-be8dd61a00c4","Type":"ContainerStarted","Data":"de5a16952f20d124fbedcdfd8ee8198f3407cbad29e765d1f086b2be9e827179"}
May 26 23:50:06.189750 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:06.189675    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p84fd" event={"ID":"7807e339-39fa-48e5-8bbd-be8dd61a00c4","Type":"ContainerStarted","Data":"f8a24d1b5c8523ce7043614ac25526bbbfb77b2db37ad5aa0315c0383743e192"}
May 26 23:50:06.203004 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:50:06.202964    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p84fd" podStartSLOduration=1.524256093 podStartE2EDuration="5.202949676s" podCreationTimestamp="2026-05-26 23:50:01 +0000 UTC" firstStartedPulling="2026-05-26 23:50:02.136700516 +0000 UTC m=+356.739946639" lastFinishedPulling="2026-05-26 23:50:05.815394098 +0000 UTC m=+360.418640222" observedRunningTime="2026-05-26 23:50:06.202062417 +0000 UTC m=+360.805308558" watchObservedRunningTime="2026-05-26 23:50:06.202949676 +0000 UTC m=+360.806195819"
May 26 23:53:23.609568 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.609486    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d65cbfd9b-2g5b5"]
May 26 23:53:23.612618 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.612592    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.614635 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.614609    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 23:53:23.614759 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.614722    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 23:53:23.615680 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.615656    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 23:53:23.615680 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.615664    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 23:53:23.615841 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.615752    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 23:53:23.615841 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.615810    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qkjcw\""
May 26 23:53:23.619815 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.619796    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 23:53:23.623670 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.623649    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65cbfd9b-2g5b5"]
May 26 23:53:23.741315 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-oauth-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-trusted-ca-bundle\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpshn\" (UniqueName: \"kubernetes.io/projected/ae67e790-5410-49ec-94ee-479d296849f8-kube-api-access-xpshn\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741518 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-service-ca\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741676 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-console-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.741676 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.741537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-oauth-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842589 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842550    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842589 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842595    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-oauth-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842834 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842619    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-trusted-ca-bundle\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842834 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842644    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpshn\" (UniqueName: \"kubernetes.io/projected/ae67e790-5410-49ec-94ee-479d296849f8-kube-api-access-xpshn\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842834 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842717    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-service-ca\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.842834 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842744    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-console-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.843019 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.842878    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-oauth-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.843439 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.843411    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-service-ca\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.843544 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.843523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-oauth-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.843613 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.843597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-console-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.843761 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.843745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae67e790-5410-49ec-94ee-479d296849f8-trusted-ca-bundle\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.845472 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.845449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-oauth-config\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.845672 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.845652    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae67e790-5410-49ec-94ee-479d296849f8-console-serving-cert\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.849726 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.849706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpshn\" (UniqueName: \"kubernetes.io/projected/ae67e790-5410-49ec-94ee-479d296849f8-kube-api-access-xpshn\") pod \"console-5d65cbfd9b-2g5b5\" (UID: \"ae67e790-5410-49ec-94ee-479d296849f8\") " pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:23.922582 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:23.922499    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:24.044491 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:24.044466    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65cbfd9b-2g5b5"]
May 26 23:53:24.047270 ip-10-0-128-145 kubenswrapper[2576]: W0526 23:53:24.047243    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae67e790_5410_49ec_94ee_479d296849f8.slice/crio-5b03e33ddf6a7fb5417cc0af42614939722adb83e0f794f31debe913301ac1be WatchSource:0}: Error finding container 5b03e33ddf6a7fb5417cc0af42614939722adb83e0f794f31debe913301ac1be: Status 404 returned error can't find the container with id 5b03e33ddf6a7fb5417cc0af42614939722adb83e0f794f31debe913301ac1be
May 26 23:53:24.757325 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:24.757288    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65cbfd9b-2g5b5" event={"ID":"ae67e790-5410-49ec-94ee-479d296849f8","Type":"ContainerStarted","Data":"bf87b5eb7131e4b9ada5fc5eb9b622d67e09cbbbf1eef48114e8a750e8cac425"}
May 26 23:53:24.757710 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:24.757331    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65cbfd9b-2g5b5" event={"ID":"ae67e790-5410-49ec-94ee-479d296849f8","Type":"ContainerStarted","Data":"5b03e33ddf6a7fb5417cc0af42614939722adb83e0f794f31debe913301ac1be"}
May 26 23:53:24.773690 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:24.773644    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d65cbfd9b-2g5b5" podStartSLOduration=1.773629041 podStartE2EDuration="1.773629041s" podCreationTimestamp="2026-05-26 23:53:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 23:53:24.772946284 +0000 UTC m=+559.376192422" watchObservedRunningTime="2026-05-26 23:53:24.773629041 +0000 UTC m=+559.376875185"
May 26 23:53:33.923204 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:33.923166    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:33.923204 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:33.923209    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:33.928010 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:33.927987    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:53:34.800737 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:53:34.800709    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d65cbfd9b-2g5b5"
May 26 23:54:05.941377 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:54:05.941335    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:54:05.943155 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:54:05.943134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:59:05.964152 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:59:05.964120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 26 23:59:05.966299 ip-10-0-128-145 kubenswrapper[2576]: I0526 23:59:05.966280    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:04:05.986116 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:04:05.986086    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:04:05.988006 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:04:05.987984    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:09:06.008120 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:09:06.008091    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:09:06.010182 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:09:06.010162    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:14:06.036857 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:06.036832    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:14:06.039393 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:06.039357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:14:39.874068 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:39.874036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p84fd_7807e339-39fa-48e5-8bbd-be8dd61a00c4/global-pull-secret-syncer/0.log"
May 27 00:14:39.917344 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:39.917304    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d6pzt_6947a497-4661-454a-8750-4779cb06423d/konnectivity-agent/0.log"
May 27 00:14:39.991323 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:39.991293    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-145.ec2.internal_8c8e0f9f7c8717b0b45bd8d3f6aab997/haproxy/0.log"
May 27 00:14:42.584105 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.584078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/alertmanager/0.log"
May 27 00:14:42.609835 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.609811    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/config-reloader/0.log"
May 27 00:14:42.637480 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.637455    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/kube-rbac-proxy-web/0.log"
May 27 00:14:42.662476 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.662453    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/kube-rbac-proxy/0.log"
May 27 00:14:42.686328 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.686303    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/kube-rbac-proxy-metric/0.log"
May 27 00:14:42.716198 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.716174    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/prom-label-proxy/0.log"
May 27 00:14:42.745166 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.745143    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8447f508-153a-4623-9b34-a068a5b6e2c2/init-config-reloader/0.log"
May 27 00:14:42.809271 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.809244    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-2x4cg_d57bec4c-366f-4a0c-a12a-88d8dee08a8b/cluster-monitoring-operator/0.log"
May 27 00:14:42.977900 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.977869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62ljk_3e2ccfa9-1859-48e8-ab12-a56e130a6609/node-exporter/0.log"
May 27 00:14:42.999698 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:42.999672    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62ljk_3e2ccfa9-1859-48e8-ab12-a56e130a6609/kube-rbac-proxy/0.log"
May 27 00:14:43.020780 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.020754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62ljk_3e2ccfa9-1859-48e8-ab12-a56e130a6609/init-textfile/0.log"
May 27 00:14:43.189999 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.189972    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-b9x6b_ea04bd9e-b3f0-4177-bf15-b4d863a79347/kube-rbac-proxy-main/0.log"
May 27 00:14:43.211279 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.211255    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-b9x6b_ea04bd9e-b3f0-4177-bf15-b4d863a79347/kube-rbac-proxy-self/0.log"
May 27 00:14:43.233645 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.233626    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-b9x6b_ea04bd9e-b3f0-4177-bf15-b4d863a79347/openshift-state-metrics/0.log"
May 27 00:14:43.273933 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.273908    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/prometheus/0.log"
May 27 00:14:43.296634 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.296603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/config-reloader/0.log"
May 27 00:14:43.319344 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.319320    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/thanos-sidecar/0.log"
May 27 00:14:43.340612 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.340575    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/kube-rbac-proxy-web/0.log"
May 27 00:14:43.361957 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.361888    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/kube-rbac-proxy/0.log"
May 27 00:14:43.384355 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.384329    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/kube-rbac-proxy-thanos/0.log"
May 27 00:14:43.407986 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.407963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a294b45-d599-4068-bca4-099188ed74b5/init-config-reloader/0.log"
May 27 00:14:43.503951 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.503924    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677969cd7b-tnhdc_a715d264-3b92-4bca-b242-10f4b736b609/telemeter-client/0.log"
May 27 00:14:43.523144 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.523115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677969cd7b-tnhdc_a715d264-3b92-4bca-b242-10f4b736b609/reload/0.log"
May 27 00:14:43.544443 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:43.544417    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677969cd7b-tnhdc_a715d264-3b92-4bca-b242-10f4b736b609/kube-rbac-proxy/0.log"
May 27 00:14:45.548973 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:45.548947    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d65cbfd9b-2g5b5_ae67e790-5410-49ec-94ee-479d296849f8/console/0.log"
May 27 00:14:45.575234 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:45.575202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-pfqj9_69b7f995-dfa4-4014-8d41-e08104749033/download-server/0.log"
May 27 00:14:45.954999 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:45.954933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-n5rrw_d3bac0fc-a4fe-4b8c-bd6c-be592d92976f/volume-data-source-validator/0.log"
May 27 00:14:46.539517 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.539474    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"]
May 27 00:14:46.544038 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.544012    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.547285 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.547262    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twt48\"/\"openshift-service-ca.crt\""
May 27 00:14:46.548009 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.547989    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-twt48\"/\"default-dockercfg-lcfnn\""
May 27 00:14:46.548135 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.548055    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twt48\"/\"kube-root-ca.crt\""
May 27 00:14:46.550715 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.550695    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"]
May 27 00:14:46.575157 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.575130    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgsgb_88a29149-3c3d-4fe9-bb08-e17eeb0c123f/dns/0.log"
May 27 00:14:46.593820 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.593796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kgsgb_88a29149-3c3d-4fe9-bb08-e17eeb0c123f/kube-rbac-proxy/0.log"
May 27 00:14:46.652387 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.652335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-lib-modules\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.652556 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.652399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-sys\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.652556 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.652483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8xm\" (UniqueName: \"kubernetes.io/projected/7054eb5a-98a8-4547-8f22-8577ee8c637d-kube-api-access-cg8xm\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.652556 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.652502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-proc\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.652556 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.652526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-podres\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.699753 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.699724    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ws8g9_310ab732-4829-40b6-adce-a5b52b81d43f/dns-node-resolver/0.log"
May 27 00:14:46.753923 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.753891    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8xm\" (UniqueName: \"kubernetes.io/projected/7054eb5a-98a8-4547-8f22-8577ee8c637d-kube-api-access-cg8xm\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.753923 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.753927    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-proc\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754130 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754000    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-proc\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754130 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754026    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-podres\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754130 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754060    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-lib-modules\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754130 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754077    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-sys\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754302 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754140    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-sys\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754302 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-lib-modules\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.754302 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.754213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7054eb5a-98a8-4547-8f22-8577ee8c637d-podres\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.761910 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.761885    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8xm\" (UniqueName: \"kubernetes.io/projected/7054eb5a-98a8-4547-8f22-8577ee8c637d-kube-api-access-cg8xm\") pod \"perf-node-gather-daemonset-gckp7\" (UID: \"7054eb5a-98a8-4547-8f22-8577ee8c637d\") " pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.855680 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.855651    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:46.981587 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.981561    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"]
May 27 00:14:46.983758 ip-10-0-128-145 kubenswrapper[2576]: W0527 00:14:46.983725    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7054eb5a_98a8_4547_8f22_8577ee8c637d.slice/crio-174b0a9c0e2e61d3dfb0060d0c7f1515196ca2ee01f0ad474260cc134c706c70 WatchSource:0}: Error finding container 174b0a9c0e2e61d3dfb0060d0c7f1515196ca2ee01f0ad474260cc134c706c70: Status 404 returned error can't find the container with id 174b0a9c0e2e61d3dfb0060d0c7f1515196ca2ee01f0ad474260cc134c706c70
May 27 00:14:46.985435 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:46.985420    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 00:14:47.132819 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.132715    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jbnnd_d53ddee6-0228-4d40-a2c9-dac5da5abd2d/node-ca/0.log"
May 27 00:14:47.546866 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.546835    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7" event={"ID":"7054eb5a-98a8-4547-8f22-8577ee8c637d","Type":"ContainerStarted","Data":"23576ca263fdd344c2312c116084d64ed5a371c4581be025b2b7a21a00b57ef6"}
May 27 00:14:47.546866 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.546868    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7" event={"ID":"7054eb5a-98a8-4547-8f22-8577ee8c637d","Type":"ContainerStarted","Data":"174b0a9c0e2e61d3dfb0060d0c7f1515196ca2ee01f0ad474260cc134c706c70"}
May 27 00:14:47.547061 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.546953    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:47.562230 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.562179    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7" podStartSLOduration=1.562165391 podStartE2EDuration="1.562165391s" podCreationTimestamp="2026-05-27 00:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 00:14:47.561613763 +0000 UTC m=+1842.164859908" watchObservedRunningTime="2026-05-27 00:14:47.562165391 +0000 UTC m=+1842.165411534"
May 27 00:14:47.817217 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:47.817125    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76cbb4bb96-nx9q6_d94df388-34ea-444f-be64-5bbbb5733e98/router/0.log"
May 27 00:14:48.146410 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.146308    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-txvg5_5a247352-647d-4a30-aa69-cc2371cf3fc6/serve-healthcheck-canary/0.log"
May 27 00:14:48.446097 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.446021    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-fh6ks_a61198ab-e53a-4640-8f8f-79c2532e96c3/insights-operator/1.log"
May 27 00:14:48.446245 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.446177    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-fh6ks_a61198ab-e53a-4640-8f8f-79c2532e96c3/insights-operator/0.log"
May 27 00:14:48.464436 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.464402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gf6h_ff6bda43-6021-424c-95d6-2443c091b447/kube-rbac-proxy/0.log"
May 27 00:14:48.482864 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.482838    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gf6h_ff6bda43-6021-424c-95d6-2443c091b447/exporter/0.log"
May 27 00:14:48.501872 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:48.501848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8gf6h_ff6bda43-6021-424c-95d6-2443c091b447/extractor/0.log"
May 27 00:14:53.505071 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.505043    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/kube-multus-additional-cni-plugins/0.log"
May 27 00:14:53.523860 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.523836    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/egress-router-binary-copy/0.log"
May 27 00:14:53.543172 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.543151    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/cni-plugins/0.log"
May 27 00:14:53.560026 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.560006    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-twt48/perf-node-gather-daemonset-gckp7"
May 27 00:14:53.560952 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.560935    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/bond-cni-plugin/0.log"
May 27 00:14:53.611004 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.610977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/routeoverride-cni/0.log"
May 27 00:14:53.632388 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.632353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/whereabouts-cni-bincopy/0.log"
May 27 00:14:53.650378 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.650350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhtt8_b31e8bbf-45b2-46ca-97d5-59e7f556b489/whereabouts-cni/0.log"
May 27 00:14:53.842089 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.842052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jx9r6_0e6bff90-4110-4a6a-b1f8-87adeb86bfe2/kube-multus/0.log"
May 27 00:14:53.963473 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.963446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n984x_6df59971-f956-4ab6-9811-882e6efb9af0/network-metrics-daemon/0.log"
May 27 00:14:53.981087 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:53.981066    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n984x_6df59971-f956-4ab6-9811-882e6efb9af0/kube-rbac-proxy/0.log"
May 27 00:14:54.631855 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.631826    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-controller/0.log"
May 27 00:14:54.651156 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.651133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/0.log"
May 27 00:14:54.659055 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.659022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovn-acl-logging/1.log"
May 27 00:14:54.677732 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.677709    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/kube-rbac-proxy-node/0.log"
May 27 00:14:54.698064 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.698024    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/kube-rbac-proxy-ovn-metrics/0.log"
May 27 00:14:54.716097 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.716070    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/northd/0.log"
May 27 00:14:54.737120 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.737098    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/nbdb/0.log"
May 27 00:14:54.755588 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.755565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/sbdb/0.log"
May 27 00:14:54.848382 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:54.848343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69qqq_cd4f0b10-e05e-4ba5-9334-39145d79d60c/ovnkube-controller/0.log"
May 27 00:14:56.396265 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:56.396225    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-jqvtb_8ee555ab-a803-4045-96f8-3bd3a6344924/check-endpoints/0.log"
May 27 00:14:56.460147 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:56.460116    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wrfhw_122c7638-6939-4d65-ae9a-f59d90403db0/network-check-target-container/0.log"
May 27 00:14:57.368833 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:57.368809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zqr9w_cd0aedc4-ab08-4357-a9af-57c938b0c685/iptables-alerter/0.log"
May 27 00:14:57.986869 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:57.986841    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bf745_99f4a489-490b-4d4b-b483-941c9dbf14ac/tuned/0.log"
May 27 00:14:59.492947 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:59.492921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-97srz_3378257b-ed3d-4e54-8ced-21e93e0c690e/cluster-samples-operator/0.log"
May 27 00:14:59.507522 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:14:59.507499    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-97srz_3378257b-ed3d-4e54-8ced-21e93e0c690e/cluster-samples-operator-watch/0.log"
May 27 00:15:00.390199 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:15:00.390170    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sn6r9_73c2c27c-8a3f-41b0-9b79-ca909459510f/service-ca-operator/1.log"
May 27 00:15:00.390876 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:15:00.390860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-sn6r9_73c2c27c-8a3f-41b0-9b79-ca909459510f/service-ca-operator/0.log"
May 27 00:15:01.053919 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:15:01.053893    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tj8xn_cec668f2-b490-4837-a4fe-ff685a66a5f4/csi-driver/0.log"
May 27 00:15:01.074557 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:15:01.074534    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tj8xn_cec668f2-b490-4837-a4fe-ff685a66a5f4/csi-node-driver-registrar/0.log"
May 27 00:15:01.094022 ip-10-0-128-145 kubenswrapper[2576]: I0527 00:15:01.093999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tj8xn_cec668f2-b490-4837-a4fe-ff685a66a5f4/csi-liveness-probe/0.log"