May 23 22:02:42.474184 ip-10-0-137-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 23 22:02:42.474199 ip-10-0-137-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 23 22:02:42.474208 ip-10-0-137-7 systemd[1]: kubelet.service: Failed with result 'resources'.
May 23 22:02:42.474510 ip-10-0-137-7 systemd[1]: Failed to start Kubernetes Kubelet.
May 23 22:02:52.558706 ip-10-0-137-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 23 22:02:52.558724 ip-10-0-137-7 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4f7d5c36971248fbbc03437844ea7735 --
May 23 22:05:12.749312 ip-10-0-137-7 systemd[1]: Starting Kubernetes Kubelet...
May 23 22:05:13.239666 ip-10-0-137-7 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 23 22:05:13.239666 ip-10-0-137-7 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 23 22:05:13.239666 ip-10-0-137-7 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 23 22:05:13.239666 ip-10-0-137-7 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 23 22:05:13.239666 ip-10-0-137-7 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 23 22:05:13.242440 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.242350    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 23 22:05:13.246798 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246776    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 23 22:05:13.246798 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246795    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 23 22:05:13.246798 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246799    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 23 22:05:13.246798 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246803    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246805    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246808    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246811    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246814    2575 feature_gate.go:328] unrecognized feature gate: Example
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246817    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246819    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246822    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246826    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246830    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246833    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246836    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246839    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246841    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246844    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246847    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246850    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246852    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246855    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 23 22:05:13.246965 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246858    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246860    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246863    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246865    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246868    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246871    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246873    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246879    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246881    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246884    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246886    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246890    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246892    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246895    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246898    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246901    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246904    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246907    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246910    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246912    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 23 22:05:13.247446 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246915    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246917    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246920    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246923    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246925    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246928    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246930    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246933    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246935    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246938    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246940    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246943    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246945    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246948    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246951    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246953    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246956    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246958    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246961    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246963    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 23 22:05:13.247941 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246966    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246969    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246971    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246974    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246977    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246979    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246982    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246986    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246989    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246991    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246994    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246997    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.246999    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247002    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247004    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247007    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247013    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247018    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247021    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 23 22:05:13.248451 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247024    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247027    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247030    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247033    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247035    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247455    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247462    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247465    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247469    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247474    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247477    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247480    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247482    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247485    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247488    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247491    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247494    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247496    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247499    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247502    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 23 22:05:13.248919 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247505    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247508    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247511    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247513    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247516    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247519    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247521    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247524    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247526    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247529    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247532    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247535    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247538    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247540    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247543    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247545    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247548    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247551    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247554    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247557    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 23 22:05:13.249433 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247559    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247562    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247564    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247567    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247569    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247572    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247574    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247577    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247580    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247585    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247589    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247592    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247596    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247598    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247601    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247604    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247606    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247609    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247611    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 23 22:05:13.249934 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247614    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247617    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247619    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247622    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247625    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247628    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247630    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247633    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247635    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247638    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247640    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247643    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247645    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247649    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247652    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247654    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247657    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247659    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247662    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247665    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 23 22:05:13.250411 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247667    2575 feature_gate.go:328] unrecognized feature gate: Example
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247670    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247673    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247675    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247678    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247681    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247683    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247685    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247688    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247690    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247693    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.247695    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249288    2575 flags.go:64] FLAG: --address="0.0.0.0"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249300    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249309    2575 flags.go:64] FLAG: --anonymous-auth="true"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249314    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249320    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249323    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249328    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249332    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249335    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 23 22:05:13.250913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249338    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249342    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249345    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249348    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249352    2575 flags.go:64] FLAG: --cgroup-root=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249355    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249359    2575 flags.go:64] FLAG: --client-ca-file=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249362    2575 flags.go:64] FLAG: --cloud-config=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249364    2575 flags.go:64] FLAG: --cloud-provider="external"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249367    2575 flags.go:64] FLAG: --cluster-dns="[]"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249372    2575 flags.go:64] FLAG: --cluster-domain=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249375    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249378    2575 flags.go:64] FLAG: --config-dir=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249381    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249385    2575 flags.go:64] FLAG: --container-log-max-files="5"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249389    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249392    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249396    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249399    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249402    2575 flags.go:64] FLAG: --contention-profiling="false"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249406    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249409    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249412    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249415    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249420    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 23 22:05:13.251446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249423    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249426    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249428    2575 flags.go:64] FLAG: --enable-load-reader="false"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249433    2575 flags.go:64] FLAG: --enable-server="true"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249436    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249450    2575 flags.go:64] FLAG: --event-burst="100"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249454    2575 flags.go:64] FLAG: --event-qps="50"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249456    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249460    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249463    2575 flags.go:64] FLAG: --eviction-hard=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249471    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249474    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249477    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249480    2575 flags.go:64] FLAG: --eviction-soft=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249483    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249486    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249489    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249492    2575 flags.go:64] FLAG: --experimental-mounter-path=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249495    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249501    2575 flags.go:64] FLAG: --fail-swap-on="true"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249504    2575 flags.go:64] FLAG: --feature-gates=""
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249508    2575 flags.go:64] FLAG: --file-check-frequency="20s"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249511    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249514    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249518    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249521    2575 flags.go:64] FLAG: --healthz-port="10248"
May 23 22:05:13.252059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249523    2575 flags.go:64] FLAG: --help="false"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249526    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-7.ec2.internal"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249529    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249532    2575 flags.go:64] FLAG: --http-check-frequency="20s"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249535    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249538    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249542    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249545    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249548    2575 flags.go:64] FLAG: --image-service-endpoint=""
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249550    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249553    2575 flags.go:64] FLAG: --kube-api-burst="100"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249556    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249560    2575 flags.go:64] FLAG: --kube-api-qps="50"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249562    2575 flags.go:64] FLAG: --kube-reserved=""
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249565    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249568    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249571    2575 flags.go:64] FLAG: --kubelet-cgroups=""
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249574    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249577    2575 flags.go:64] FLAG: --lock-file=""
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249580    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249582    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249585    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249591    2575 flags.go:64] FLAG: --log-json-split-stream="false"
May 23 22:05:13.252714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249594    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249596    2575 flags.go:64] FLAG: --log-text-split-stream="false"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249600    2575 flags.go:64] FLAG: --logging-format="text"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249603    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249607    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249610    2575 flags.go:64] FLAG: --manifest-url=""
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249612    2575 flags.go:64] FLAG: --manifest-url-header=""
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249617    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249620    2575 flags.go:64] FLAG: --max-open-files="1000000"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249624    2575 flags.go:64] FLAG: --max-pods="110"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249627    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249630    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249633    2575 flags.go:64] FLAG: --memory-manager-policy="None"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249635    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249639    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249641    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249644    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249652    2575 flags.go:64] FLAG: --node-status-max-images="50"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249655    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249658    2575 flags.go:64] FLAG: --oom-score-adj="-999"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249661    2575 flags.go:64] FLAG: --pod-cidr=""
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249664    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249670    2575 flags.go:64] FLAG: --pod-manifest-path=""
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249673    2575 flags.go:64] FLAG: --pod-max-pids="-1"
May 23 22:05:13.253361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249676    2575 flags.go:64] FLAG: --pods-per-core="0"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249679    2575 flags.go:64] FLAG: --port="10250"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249682    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249685    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010bd3bcac23cc7aa"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249689    2575 flags.go:64] FLAG: --qos-reserved=""
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249692    2575 flags.go:64] FLAG: --read-only-port="10255"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249695    2575 flags.go:64] FLAG: --register-node="true"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249697    2575 flags.go:64] FLAG: --register-schedulable="true"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249700    2575 flags.go:64] FLAG: --register-with-taints=""
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249704    2575 flags.go:64] FLAG: --registry-burst="10"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249707    2575 flags.go:64] FLAG: --registry-qps="5"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249710    2575 flags.go:64] FLAG: --reserved-cpus=""
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249713    2575 flags.go:64] FLAG: --reserved-memory=""
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249717    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249720    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249723    2575 flags.go:64] FLAG: --rotate-certificates="false"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249726    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249729    2575 flags.go:64] FLAG: --runonce="false"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249732    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249735    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249737    2575 flags.go:64] FLAG: --seccomp-default="false"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249740    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249743    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249746    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249749    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249752    2575 flags.go:64] FLAG: --storage-driver-password="root"
May 23 22:05:13.253973 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249755    2575 flags.go:64] FLAG: --storage-driver-secure="false"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249758    2575 flags.go:64] FLAG: --storage-driver-table="stats"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249760    2575 flags.go:64] FLAG: --storage-driver-user="root"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249764    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249767    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249770    2575 flags.go:64] FLAG: --system-cgroups=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249773    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249779    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249781    2575 flags.go:64] FLAG: --tls-cert-file=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249784    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249788    2575 flags.go:64] FLAG: --tls-min-version=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249791    2575 flags.go:64] FLAG: --tls-private-key-file=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249794    2575 flags.go:64] FLAG: --topology-manager-policy="none"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249797    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249800    2575 flags.go:64] FLAG: --topology-manager-scope="container"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249803    2575 flags.go:64] FLAG: --v="2"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249807    2575 flags.go:64] FLAG: --version="false"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249813    2575 flags.go:64] FLAG: --vmodule=""
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249818    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.249821    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249912    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249916    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249919    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249922    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 23 22:05:13.254628 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249925    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249928    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249931    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249934    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249937    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249940    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249943    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249946    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249950    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249954    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249957    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249960    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249963    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249966    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249969    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249971    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249974    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249979    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249981    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249984    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 23 22:05:13.255214 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249987    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249989    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249992    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249994    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.249997    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250000    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250003    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250006    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250008    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250011    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250013    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250016    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250018    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250021    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250024    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250026    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250029    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250031    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250034    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250036    2575 feature_gate.go:328] unrecognized feature gate: Example
May 23 22:05:13.255721 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250039    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250042    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250044    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250060    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250062    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250065    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250068    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250070    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250073    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250077    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250080    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250082    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250085    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250087    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250090    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250093    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250095    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250098    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250101    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 23 22:05:13.256229 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250105    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250109    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250112    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250114    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250117    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250119    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250122    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250125    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250128    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250130    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250133    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250135    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250138    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250141    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250144    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250146    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250149    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250151    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250154    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250157    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 23 22:05:13.256791 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250160    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 23 22:05:13.257724 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250162    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 23 22:05:13.257724 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.250166    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 23 22:05:13.257724 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.251129    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 23 22:05:13.258468 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.258354    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 23 22:05:13.258468 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.258469    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258536    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258543    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258549    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258554    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258559    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258564    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258568    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258573    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258577    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258582    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258586    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258590    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258594    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258599    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258603    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258608    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258612    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 23 22:05:13.258609 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258616    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258621    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258626    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258630    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258635    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258639    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258643    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258648    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258652    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258656    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258660    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258664    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258668    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258673    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258679    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258684    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258688    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258692    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258696    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 23 22:05:13.259414 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258700    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258706    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258712    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258717    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258721    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258726    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258731    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258737    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258741    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258745    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258749    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258753    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258757    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258761    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258765    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258771    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258775    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258780    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258784    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 23 22:05:13.259992 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258789    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258793    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258797    2575 feature_gate.go:328] unrecognized feature gate: Example
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258801    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258805    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258809    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258814    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258818    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258823    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258827    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258832    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258836    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258840    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258844    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258848    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258852    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258856    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258860    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258864    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258868    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 23 22:05:13.260525 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258873    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258877    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258881    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258885    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258889    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258893    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258898    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258902    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258907    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258912    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.258916    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.258925    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259102    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259110    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259114    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 23 22:05:13.261083 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259118    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259123    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259128    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259132    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259136    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259140    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259145    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259150    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259154    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259158    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259162    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259166    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259171    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259175    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259180    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259185    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259189    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259193    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259200    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 23 22:05:13.261660 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259206    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259211    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259215    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259220    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259224    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259228    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259233    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259237    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259241    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259246    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259250    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259254    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259258    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259262    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259267    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259271    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259275    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259281    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259287    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259292    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 23 22:05:13.262248 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259296    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259301    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259305    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259309    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259313    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259317    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259321    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259325    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259330    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259334    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259338    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259342    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259346    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259350    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259355    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259359    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259363    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259367    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259371    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259375    2575 feature_gate.go:328] unrecognized feature gate: Example
May 23 22:05:13.262784 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259379    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259383    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259388    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259392    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259396    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259401    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259405    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259409    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259413    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259417    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259421    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259425    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259429    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259433    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259438    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259443    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259447    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259451    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259455    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259460    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 23 22:05:13.263323 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259464    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 23 22:05:13.263948 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259468    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 23 22:05:13.263948 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259472    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 23 22:05:13.263948 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:13.259476    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 23 22:05:13.263948 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.259484    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 23 22:05:13.263948 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.260471    2575 server.go:962] "Client rotation is on, will bootstrap in background"
May 23 22:05:13.265226 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.265211    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 23 22:05:13.266337 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.266325    2575 server.go:1019] "Starting client certificate rotation"
May 23 22:05:13.266441 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.266424    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 23 22:05:13.266484 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.266465    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 23 22:05:13.295875 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.295851    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 23 22:05:13.301573 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.301552    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 23 22:05:13.323768 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.323751    2575 log.go:25] "Validated CRI v1 runtime API"
May 23 22:05:13.328571 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.328552    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 23 22:05:13.330029 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.330017    2575 log.go:25] "Validated CRI v1 image API"
May 23 22:05:13.331483 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.331469    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 23 22:05:13.333853 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.333836    2575 fs.go:135] Filesystem UUIDs: map[1e0123b3-cba2-41e3-8bf7-c519bc7d1222:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a16a721f-849e-4d15-b819-1b13f44dd1c6:/dev/nvme0n1p4]
May 23 22:05:13.333913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.333854    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 23 22:05:13.338085 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.337965    2575 manager.go:217] Machine: {Timestamp:2026-05-23 22:05:13.337472839 +0000 UTC m=+0.458063022 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094500 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2323840e7677884a3fbdc2dfe6a113 SystemUUID:ec232384-0e76-7788-4a3f-bdc2dfe6a113 BootID:4f7d5c36-9712-48fb-bc03-437844ea7735 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:9f:40:dd:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:9f:40:dd:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:80:f3:5e:dd:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 23 22:05:13.338921 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.338911    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 23 22:05:13.339003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.338991    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 23 22:05:13.342571 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.342548    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 23 22:05:13.342705 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.342573    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 23 22:05:13.342754 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.342714    2575 topology_manager.go:138] "Creating topology manager with none policy"
May 23 22:05:13.342754 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.342722    2575 container_manager_linux.go:306] "Creating device plugin manager"
May 23 22:05:13.342754 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.342729    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 23 22:05:13.343527 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.343517    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 23 22:05:13.346005 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.345995    2575 state_mem.go:36] "Initialized new in-memory state store"
May 23 22:05:13.346134 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.346124    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 23 22:05:13.348982 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.348971    2575 kubelet.go:491] "Attempting to sync node with API server"
May 23 22:05:13.349016 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.348990    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 23 22:05:13.349016 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.349002    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 23 22:05:13.349016 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.349013    2575 kubelet.go:397] "Adding apiserver pod source"
May 23 22:05:13.349141 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.349021    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 23 22:05:13.349653 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.349636    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pgphh"
May 23 22:05:13.350200 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.350189    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 23 22:05:13.350241 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.350208    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 23 22:05:13.353558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.353540    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 23 22:05:13.354808 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.354794    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pgphh"
May 23 22:05:13.355924 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.355908    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 23 22:05:13.356869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356857    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356873    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356880    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356885    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356893    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356910    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 23 22:05:13.356917 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356917    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 23 22:05:13.357095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356923    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 23 22:05:13.357095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356930    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 23 22:05:13.357095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356935    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 23 22:05:13.357095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.356950    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 23 22:05:13.357319 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.357306    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 23 22:05:13.357352 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.357333    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 23 22:05:13.357352 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.357338    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 23 22:05:13.360743 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.360728    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 23 22:05:13.360810 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.360765    2575 server.go:1295] "Started kubelet"
May 23 22:05:13.360880 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.360850    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 23 22:05:13.360920 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.360848    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 23 22:05:13.360920 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.360916    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
May 23 22:05:13.361499 ip-10-0-137-7 systemd[1]: Started Kubernetes Kubelet.
May 23 22:05:13.362631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.362595    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:13.362928 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.362913    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 23 22:05:13.365337 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.365319    2575 server.go:317] "Adding debug handlers to kubelet server"
May 23 22:05:13.366891 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.366874    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-7.ec2.internal" not found
May 23 22:05:13.366971 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.366952    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:13.371362 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.371339    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 23 22:05:13.371440 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.371414    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 23 22:05:13.372083 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372066    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 23 22:05:13.372275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372230    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
May 23 22:05:13.372275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372247    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 23 22:05:13.372418 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372294    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 23 22:05:13.372418 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372398    2575 reconstruct.go:97] "Volume reconstruction finished"
May 23 22:05:13.372418 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372408    2575 reconciler.go:26] "Reconciler: start to sync state"
May 23 22:05:13.372656 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372638    2575 factory.go:55] Registering systemd factory
May 23 22:05:13.372656 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372657    2575 factory.go:223] Registration of the systemd container factory successfully
May 23 22:05:13.372867 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372854    2575 factory.go:153] Registering CRI-O factory
May 23 22:05:13.372918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372871    2575 factory.go:223] Registration of the crio container factory successfully
May 23 22:05:13.372951 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372919    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 23 22:05:13.372951 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372938    2575 factory.go:103] Registering Raw factory
May 23 22:05:13.373059 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.372953    2575 manager.go:1196] Started watching for new ooms in manager
May 23 22:05:13.373059 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.373034    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-7.ec2.internal\" not found"
May 23 22:05:13.373364 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.373351    2575 manager.go:319] Starting recovery of all containers
May 23 22:05:13.374811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.374790    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:13.377180 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.377160    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-7.ec2.internal\" not found" node="ip-10-0-137-7.ec2.internal"
May 23 22:05:13.382154 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.382133    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-7.ec2.internal" not found
May 23 22:05:13.383270 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.383253    2575 manager.go:324] Recovery completed
May 23 22:05:13.387198 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.387186    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 23 22:05:13.388825 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.388811    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasSufficientMemory"
May 23 22:05:13.388889 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.388836    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasNoDiskPressure"
May 23 22:05:13.388889 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.388858    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasSufficientPID"
May 23 22:05:13.389348 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.389331    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 23 22:05:13.389348 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.389345    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 23 22:05:13.389433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.389364    2575 state_mem.go:36] "Initialized new in-memory state store"
May 23 22:05:13.393790 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.393777    2575 policy_none.go:49] "None policy: Start"
May 23 22:05:13.393790 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.393792    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
May 23 22:05:13.393867 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.393803    2575 state_mem.go:35] "Initializing new in-memory state store"
May 23 22:05:13.428639 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.428624    2575 manager.go:341] "Starting Device Plugin manager"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.428660    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.428674    2575 server.go:85] "Starting device plugin registration server"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.428890    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.428903    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.428991    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.429086    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.429095    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.429731    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.429768    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-7.ec2.internal\" not found"
May 23 22:05:13.457073 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.439337    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-7.ec2.internal" not found
May 23 22:05:13.469553 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.469533    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 23 22:05:13.470622 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.470603    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 23 22:05:13.470704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.470633    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
May 23 22:05:13.470704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.470647    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 23 22:05:13.470704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.470655    2575 kubelet.go:2451] "Starting kubelet main sync loop"
May 23 22:05:13.470704 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.470692    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 23 22:05:13.476655 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.476638    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:13.529311 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.529268    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 23 22:05:13.530238 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.530222    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasSufficientMemory"
May 23 22:05:13.530306 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.530252    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasNoDiskPressure"
May 23 22:05:13.530306 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.530263    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeHasSufficientPID"
May 23 22:05:13.530306 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.530284    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-7.ec2.internal"
May 23 22:05:13.536540 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.536524    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-7.ec2.internal"
May 23 22:05:13.571798 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.571780    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"]
May 23 22:05:13.572887 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.572864    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.574283 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.574270    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.577002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.576988    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.588410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.588395    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 23 22:05:13.603581 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.603562    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.607882 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.607868    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.626353 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.626330    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 23 22:05:13.626417 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:13.626369    2575 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.626417 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.626408    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 23 22:05:13.673396 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.673372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.673486 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.673400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.773630 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.773608    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.773721 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.773664    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.773721 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.773701    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.773811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.773724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cb67e3ce093f11801888ffea920b426-config\") pod \"kube-apiserver-proxy-ip-10-0-137-7.ec2.internal\" (UID: \"2cb67e3ce093f11801888ffea920b426\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.773811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.773767    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc60baa9b3e4f38f405fbfb0f4046d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal\" (UID: \"efc60baa9b3e4f38f405fbfb0f4046d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.874394 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.874324    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cb67e3ce093f11801888ffea920b426-config\") pod \"kube-apiserver-proxy-ip-10-0-137-7.ec2.internal\" (UID: \"2cb67e3ce093f11801888ffea920b426\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.874394 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.874378    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cb67e3ce093f11801888ffea920b426-config\") pod \"kube-apiserver-proxy-ip-10-0-137-7.ec2.internal\" (UID: \"2cb67e3ce093f11801888ffea920b426\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.928526 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.928508    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal"
May 23 22:05:13.930119 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:13.930096    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal"
May 23 22:05:14.265685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.265620    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 23 22:05:14.266427 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.265753    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 23 22:05:14.266427 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.265783    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 23 22:05:14.266427 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.265805    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 23 22:05:14.349475 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.349444    2575 apiserver.go:52] "Watching apiserver"
May 23 22:05:14.356629 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.356596    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-22 22:00:13 +0000 UTC" deadline="2028-01-03 17:52:06.814448295 +0000 UTC"
May 23 22:05:14.356629 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.356627    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14155h46m52.457825878s"
May 23 22:05:14.357275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.357254    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 23 22:05:14.358333 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.358313    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz","openshift-cluster-node-tuning-operator/tuned-f4r5c","openshift-dns/node-resolver-9m6t7","openshift-image-registry/node-ca-5kf9d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal","openshift-multus/network-metrics-daemon-d9hx9","openshift-network-diagnostics/network-check-target-86c5b","kube-system/konnectivity-agent-9cbft","openshift-multus/multus-additional-cni-plugins-4qqxb","openshift-multus/multus-zfbv6","openshift-network-operator/iptables-alerter-n4p6j","openshift-ovn-kubernetes/ovnkube-node-dwsp5"]
May 23 22:05:14.362687 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.362668    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.365213 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365186    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.365313 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365281    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.365905 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365739    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 23 22:05:14.365905 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365756    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 23 22:05:14.365905 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365812    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 23 22:05:14.365905 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.365823    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dsjx7\""
May 23 22:05:14.367217 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367202    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdm8c\""
May 23 22:05:14.367329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367312    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 23 22:05:14.367472 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367458    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.367759 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367558    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9xwv5\""
May 23 22:05:14.367759 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367559    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 23 22:05:14.367759 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.367688    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 23 22:05:14.368356 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.368342    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 23 22:05:14.369777 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.369758    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 23 22:05:14.369888 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.369821    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-blrpm\""
May 23 22:05:14.369888 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.369841    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 23 22:05:14.369888 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.369824    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 23 22:05:14.370145 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.370132    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.370210 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.370192    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:14.371526 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.371502    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 23 22:05:14.372161 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.372143    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:14.372230 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.372208    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:14.374331 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.374316    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.375909 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.375888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m29b4\" (UniqueName: \"kubernetes.io/projected/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-kube-api-access-m29b4\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.375995 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.375915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-device-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.375995 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.375932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-lib-modules\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.375995 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.375948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-var-lib-kubelet\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.375995 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.375986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-tuned\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-socket-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c5f355a-f160-4c7c-8d90-f01a17e78672-host\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdrht\" (UniqueName: \"kubernetes.io/projected/120c0999-8d75-450b-845e-786d125b7617-kube-api-access-mdrht\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-conf\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376182 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-sys\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ab5905c-3a59-4020-9eff-e9fd7377822f-agent-certs\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-modprobe-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-kubernetes\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-tmp\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-registration-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-host\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ff0be26-9ebe-4e5f-a250-c041d8255449-hosts-file\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c5f355a-f160-4c7c-8d90-f01a17e78672-serviceca\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2w4\" (UniqueName: \"kubernetes.io/projected/2c5f355a-f160-4c7c-8d90-f01a17e78672-kube-api-access-sk2w4\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmgth\" (UniqueName: \"kubernetes.io/projected/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-kube-api-access-gmgth\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.376410 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-sys-fs\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysconfig\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ab5905c-3a59-4020-9eff-e9fd7377822f-konnectivity-ca\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-run\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ff0be26-9ebe-4e5f-a250-c041d8255449-tmp-dir\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7k6t\" (UniqueName: \"kubernetes.io/projected/3ff0be26-9ebe-4e5f-a250-c041d8255449-kube-api-access-q7k6t\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.376783 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-systemd\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.377127 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.376847    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 23 22:05:14.377127 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.377041    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.377286 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.377246    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-klnqp\""
May 23 22:05:14.377368 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.377325    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 23 22:05:14.379270 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379243    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.379363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379250    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 23 22:05:14.379363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379300    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 23 22:05:14.379363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379335    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6mb22\""
May 23 22:05:14.379637 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379620    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 23 22:05:14.379724 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379640    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 23 22:05:14.379724 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.379623    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 23 22:05:14.381442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.381426    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 23 22:05:14.381442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.381439    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.381865 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.381840    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdwjh\""
May 23 22:05:14.383617 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.383598    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 23 22:05:14.383752 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.383736    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2swx\""
May 23 22:05:14.383811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.383763    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.383811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.383803    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 23 22:05:14.383915 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.383855    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 23 22:05:14.386262 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.386240    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.386385    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.386453    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.387176    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.387425    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.387618    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 23 22:05:14.388072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.387866    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tkzgt\""
May 23 22:05:14.388499 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.388149    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 23 22:05:14.406872 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.406855    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5sgtd"
May 23 22:05:14.414513 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.414499    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5sgtd"
May 23 22:05:14.426383 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.426340    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb67e3ce093f11801888ffea920b426.slice/crio-92ef1dfa9fa57694c671ef4964ad7d77ebad71ac16a8953304e6bd5d80bd1e9b WatchSource:0}: Error finding container 92ef1dfa9fa57694c671ef4964ad7d77ebad71ac16a8953304e6bd5d80bd1e9b: Status 404 returned error can't find the container with id 92ef1dfa9fa57694c671ef4964ad7d77ebad71ac16a8953304e6bd5d80bd1e9b
May 23 22:05:14.426842 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.426821    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc60baa9b3e4f38f405fbfb0f4046d4.slice/crio-086ff0912ffd8c2c3316d200a5a43cb7f0fefeafe3607771231a01ceb90e03cb WatchSource:0}: Error finding container 086ff0912ffd8c2c3316d200a5a43cb7f0fefeafe3607771231a01ceb90e03cb: Status 404 returned error can't find the container with id 086ff0912ffd8c2c3316d200a5a43cb7f0fefeafe3607771231a01ceb90e03cb
May 23 22:05:14.429957 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.429942    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 23 22:05:14.473012 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.472990    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 23 22:05:14.473521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.473489    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal" event={"ID":"2cb67e3ce093f11801888ffea920b426","Type":"ContainerStarted","Data":"92ef1dfa9fa57694c671ef4964ad7d77ebad71ac16a8953304e6bd5d80bd1e9b"}
May 23 22:05:14.474396 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.474377    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal" event={"ID":"efc60baa9b3e4f38f405fbfb0f4046d4","Type":"ContainerStarted","Data":"086ff0912ffd8c2c3316d200a5a43cb7f0fefeafe3607771231a01ceb90e03cb"}
May 23 22:05:14.476694 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-system-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.476770 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcxzl\" (UniqueName: \"kubernetes.io/projected/78db2e6c-0f35-44b4-bad4-862d3df87bbc-kube-api-access-mcxzl\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.476770 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476729    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-socket-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.476837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476776    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdrht\" (UniqueName: \"kubernetes.io/projected/120c0999-8d75-450b-845e-786d125b7617-kube-api-access-mdrht\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.476837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476801    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-conf\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.476837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-sys\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.476837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-socket-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.476837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-conf-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-multus-certs\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-etc-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-sys\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-netd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476928    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-conf\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476943    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ab5905c-3a59-4020-9eff-e9fd7377822f-agent-certs\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.477006 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.476979    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-kubernetes\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-cnibin\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477084    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-kubernetes\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-config\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477154    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477182    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-registration-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477209    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ff0be26-9ebe-4e5f-a250-c041d8255449-hosts-file\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-os-release\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477299    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ff0be26-9ebe-4e5f-a250-c041d8255449-hosts-file\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477301    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-registration-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.477338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-etc-kubernetes\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.477767 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.477458    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:14.477767 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.477513    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:14.977492493 +0000 UTC m=+2.098082679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:14.477767 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477703    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 23 22:05:14.477981 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-var-lib-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.478081 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.477994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.478081 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478017    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c5f355a-f160-4c7c-8d90-f01a17e78672-serviceca\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.478081 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478033    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2w4\" (UniqueName: \"kubernetes.io/projected/2c5f355a-f160-4c7c-8d90-f01a17e78672-kube-api-access-sk2w4\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.478253 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478080    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmgth\" (UniqueName: \"kubernetes.io/projected/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-kube-api-access-gmgth\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.478253 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478105    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.478253 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.478362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.478362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-cnibin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.478362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-netns\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.478362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-bin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.478533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478379    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ab5905c-3a59-4020-9eff-e9fd7377822f-konnectivity-ca\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.478533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478405    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-run\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.478533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478431    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7k6t\" (UniqueName: \"kubernetes.io/projected/3ff0be26-9ebe-4e5f-a250-c041d8255449-kube-api-access-q7k6t\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.478533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-kubelet\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.478533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdt9j\" (UniqueName: \"kubernetes.io/projected/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-kube-api-access-rdt9j\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.478773 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478475    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c5f355a-f160-4c7c-8d90-f01a17e78672-serviceca\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.478936 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478918    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-run\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.479018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.478997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-kubelet\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.479085 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479033    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ab5905c-3a59-4020-9eff-e9fd7377822f-konnectivity-ca\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.479085 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-systemd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.479179 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479124    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-ovn\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.479179 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479159    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-systemd\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.479272 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479232    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-systemd\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-cni-binary-copy\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479416    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-daemon-config\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcl8t\" (UniqueName: \"kubernetes.io/projected/a2a87229-f96a-4186-aafb-5d663fc8aa01-kube-api-access-gcl8t\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-host-slash\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479529    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-device-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-var-lib-kubelet\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479591    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-tuned\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479620    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c5f355a-f160-4c7c-8d90-f01a17e78672-host\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479649    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-socket-dir-parent\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-iptables-alerter-script\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-script-lib\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.479799    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhkk\" (UniqueName: \"kubernetes.io/projected/cb04e5a7-5197-4a6e-9194-2b401f159673-kube-api-access-6bhkk\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.480680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-bin\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480100    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-modprobe-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480127    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-tmp\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-netns\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480187    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-host\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-os-release\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-k8s-cni-cncf-io\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-slash\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480413    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-sys-fs\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-device-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480576    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-var-lib-kubelet\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.480644    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-modprobe-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c5f355a-f160-4c7c-8d90-f01a17e78672-host\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481210    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481276    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysconfig\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-host\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/120c0999-8d75-450b-845e-786d125b7617-sys-fs\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.481439 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481355    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysconfig\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481369    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-multus\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-hostroot\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-systemd-units\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481558    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ff0be26-9ebe-4e5f-a250-c041d8255449-tmp-dir\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-env-overrides\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481690    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m29b4\" (UniqueName: \"kubernetes.io/projected/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-kube-api-access-m29b4\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-node-log\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-log-socket\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovn-node-metrics-cert\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481852    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-lib-modules\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.481879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-system-cni-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.482874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.482217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-sysctl-d\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.482469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ff0be26-9ebe-4e5f-a250-c041d8255449-tmp-dir\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.482874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.482512    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-lib-modules\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.482778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-tmp\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.482874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.482826    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ab5905c-3a59-4020-9eff-e9fd7377822f-agent-certs\") pod \"konnectivity-agent-9cbft\" (UID: \"0ab5905c-3a59-4020-9eff-e9fd7377822f\") " pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.483483 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.483464    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-etc-tuned\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.485299 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.485278    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:14.485299 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.485301    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:14.485439 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.485314    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:14.485439 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.485374    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:14.985356582 +0000 UTC m=+2.105946774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:14.486112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.486085    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdrht\" (UniqueName: \"kubernetes.io/projected/120c0999-8d75-450b-845e-786d125b7617-kube-api-access-mdrht\") pod \"aws-ebs-csi-driver-node-ntknz\" (UID: \"120c0999-8d75-450b-845e-786d125b7617\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.486442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.486427    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmgth\" (UniqueName: \"kubernetes.io/projected/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-kube-api-access-gmgth\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.486483 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.486441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2w4\" (UniqueName: \"kubernetes.io/projected/2c5f355a-f160-4c7c-8d90-f01a17e78672-kube-api-access-sk2w4\") pod \"node-ca-5kf9d\" (UID: \"2c5f355a-f160-4c7c-8d90-f01a17e78672\") " pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.489647 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.489629    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m29b4\" (UniqueName: \"kubernetes.io/projected/c1c377a3-3117-4b46-8acd-c9f3a3a96fca-kube-api-access-m29b4\") pod \"tuned-f4r5c\" (UID: \"c1c377a3-3117-4b46-8acd-c9f3a3a96fca\") " pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.489950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.489931    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7k6t\" (UniqueName: \"kubernetes.io/projected/3ff0be26-9ebe-4e5f-a250-c041d8255449-kube-api-access-q7k6t\") pod \"node-resolver-9m6t7\" (UID: \"3ff0be26-9ebe-4e5f-a250-c041d8255449\") " pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.582513 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582448    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-multus\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.582513 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582482    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-multus\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-hostroot\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582551    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-systemd-units\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582574    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582599    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582629    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-hostroot\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582644    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582641    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582632    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-systemd-units\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582694    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-env-overrides\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582715    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582768    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-node-log\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582795    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-log-socket\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582813    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovn-node-metrics-cert\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582826    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582836    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-system-cni-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582854    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-system-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.582884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582868    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-log-socket\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582869    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcxzl\" (UniqueName: \"kubernetes.io/projected/78db2e6c-0f35-44b4-bad4-862d3df87bbc-kube-api-access-mcxzl\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-node-log\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582889    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-system-cni-dir\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582920    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-conf-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582962    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-conf-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582971    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-multus-certs\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582990    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-system-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.582997    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-etc-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-multus-certs\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583022    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-netd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583066    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-cnibin\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-etc-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583087    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-netd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583090    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583097    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-env-overrides\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-cnibin\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583126    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-config\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.583275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583148    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-cni-dir\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583165    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-os-release\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583186    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583208    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-etc-kubernetes\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583250    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb04e5a7-5197-4a6e-9194-2b401f159673-os-release\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583252    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-etc-kubernetes\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583284    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-var-lib-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583308    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583349    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-cnibin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583371    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-netns\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583379    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583370    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-var-lib-openvswitch\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583393    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-bin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583427    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-cni-bin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583436    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-kubelet\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583446    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-cnibin\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583462    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdt9j\" (UniqueName: \"kubernetes.io/projected/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-kube-api-access-rdt9j\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.584065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583464    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-netns\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583489    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-kubelet\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583499    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-var-lib-kubelet\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583512    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-systemd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-ovn\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583543    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-kubelet\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583564    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-cni-binary-copy\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583593    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-daemon-config\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583590    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-systemd\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583619    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcl8t\" (UniqueName: \"kubernetes.io/projected/a2a87229-f96a-4186-aafb-5d663fc8aa01-kube-api-access-gcl8t\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-config\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583694    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-run-ovn\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583729    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-host-slash\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583766    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583793    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-socket-dir-parent\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583801    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-binary-copy\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.584677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583830    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-iptables-alerter-script\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583852    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-host-slash\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583859    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-script-lib\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-socket-dir-parent\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.583901    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhkk\" (UniqueName: \"kubernetes.io/projected/cb04e5a7-5197-4a6e-9194-2b401f159673-kube-api-access-6bhkk\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584120    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-bin\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584151    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-netns\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584180    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-os-release\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584205    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-k8s-cni-cncf-io\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584214    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-cni-binary-copy\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a87229-f96a-4186-aafb-5d663fc8aa01-multus-daemon-config\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584228    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-slash\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584263    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-cni-bin\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584272    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-slash\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584308    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-host-run-k8s-cni-cncf-io\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584318    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78db2e6c-0f35-44b4-bad4-862d3df87bbc-host-run-netns\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584325    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb04e5a7-5197-4a6e-9194-2b401f159673-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a87229-f96a-4186-aafb-5d663fc8aa01-os-release\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.585243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovnkube-script-lib\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.585701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584444    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-iptables-alerter-script\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.585701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.584938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/78db2e6c-0f35-44b4-bad4-862d3df87bbc-ovn-node-metrics-cert\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.590977 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.590952    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdt9j\" (UniqueName: \"kubernetes.io/projected/1a58fe25-a1fb-4489-b9fc-797a8634fcdc-kube-api-access-rdt9j\") pod \"iptables-alerter-n4p6j\" (UID: \"1a58fe25-a1fb-4489-b9fc-797a8634fcdc\") " pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.591165 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.591150    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcxzl\" (UniqueName: \"kubernetes.io/projected/78db2e6c-0f35-44b4-bad4-862d3df87bbc-kube-api-access-mcxzl\") pod \"ovnkube-node-dwsp5\" (UID: \"78db2e6c-0f35-44b4-bad4-862d3df87bbc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.591293 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.591276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhkk\" (UniqueName: \"kubernetes.io/projected/cb04e5a7-5197-4a6e-9194-2b401f159673-kube-api-access-6bhkk\") pod \"multus-additional-cni-plugins-4qqxb\" (UID: \"cb04e5a7-5197-4a6e-9194-2b401f159673\") " pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.591520 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.591505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcl8t\" (UniqueName: \"kubernetes.io/projected/a2a87229-f96a-4186-aafb-5d663fc8aa01-kube-api-access-gcl8t\") pod \"multus-zfbv6\" (UID: \"a2a87229-f96a-4186-aafb-5d663fc8aa01\") " pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.685464 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.685436    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz"
May 23 22:05:14.692240 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.692219    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120c0999_8d75_450b_845e_786d125b7617.slice/crio-140560db6db3c498e8d1e09864ac536f0bf46b3f56dc85959d4e79e45d3add0d WatchSource:0}: Error finding container 140560db6db3c498e8d1e09864ac536f0bf46b3f56dc85959d4e79e45d3add0d: Status 404 returned error can't find the container with id 140560db6db3c498e8d1e09864ac536f0bf46b3f56dc85959d4e79e45d3add0d
May 23 22:05:14.700998 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.700981    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4r5c"
May 23 22:05:14.706445 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.706420    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c377a3_3117_4b46_8acd_c9f3a3a96fca.slice/crio-6f2a4a317e3f03193dbd9db30819381ad322c9b2d869e5f24410bab31102fdce WatchSource:0}: Error finding container 6f2a4a317e3f03193dbd9db30819381ad322c9b2d869e5f24410bab31102fdce: Status 404 returned error can't find the container with id 6f2a4a317e3f03193dbd9db30819381ad322c9b2d869e5f24410bab31102fdce
May 23 22:05:14.707488 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.707470    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9m6t7"
May 23 22:05:14.713160 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.713140    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff0be26_9ebe_4e5f_a250_c041d8255449.slice/crio-bf6b311f7d5a8ca9631e3ab8f575dae0ecf0abf549eb05f4eceefd343c3fd28d WatchSource:0}: Error finding container bf6b311f7d5a8ca9631e3ab8f575dae0ecf0abf549eb05f4eceefd343c3fd28d: Status 404 returned error can't find the container with id bf6b311f7d5a8ca9631e3ab8f575dae0ecf0abf549eb05f4eceefd343c3fd28d
May 23 22:05:14.735719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.735698    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kf9d"
May 23 22:05:14.740627 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.740601    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:14.740806 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.740787    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5f355a_f160_4c7c_8d90_f01a17e78672.slice/crio-0c0f262b46462c77155633c4db7d823ae20072377ab168aea17ccd8cd7b69a41 WatchSource:0}: Error finding container 0c0f262b46462c77155633c4db7d823ae20072377ab168aea17ccd8cd7b69a41: Status 404 returned error can't find the container with id 0c0f262b46462c77155633c4db7d823ae20072377ab168aea17ccd8cd7b69a41
May 23 22:05:14.745880 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.745859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab5905c_3a59_4020_9eff_e9fd7377822f.slice/crio-730a8e546dd8f2e400ab4060490644afb8d4d0a0dfcf9284e362d4cdd1610638 WatchSource:0}: Error finding container 730a8e546dd8f2e400ab4060490644afb8d4d0a0dfcf9284e362d4cdd1610638: Status 404 returned error can't find the container with id 730a8e546dd8f2e400ab4060490644afb8d4d0a0dfcf9284e362d4cdd1610638
May 23 22:05:14.746457 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.746436    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4qqxb"
May 23 22:05:14.752153 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.752136    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfbv6"
May 23 22:05:14.752631 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.752544    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb04e5a7_5197_4a6e_9194_2b401f159673.slice/crio-e3f7bacdbac9bcbc2f925d17bb2c557e9521a782f8266338f6d3c0e15527bdf0 WatchSource:0}: Error finding container e3f7bacdbac9bcbc2f925d17bb2c557e9521a782f8266338f6d3c0e15527bdf0: Status 404 returned error can't find the container with id e3f7bacdbac9bcbc2f925d17bb2c557e9521a782f8266338f6d3c0e15527bdf0
May 23 22:05:14.757594 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.757574    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a87229_f96a_4186_aafb_5d663fc8aa01.slice/crio-f81c83f6c50a81b3d0cc061049cade82b555e17beee70f5ba4c88499acc66e5b WatchSource:0}: Error finding container f81c83f6c50a81b3d0cc061049cade82b555e17beee70f5ba4c88499acc66e5b: Status 404 returned error can't find the container with id f81c83f6c50a81b3d0cc061049cade82b555e17beee70f5ba4c88499acc66e5b
May 23 22:05:14.758246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.758229    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4p6j"
May 23 22:05:14.763180 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.763160    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:14.764428 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.764409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a58fe25_a1fb_4489_b9fc_797a8634fcdc.slice/crio-6fedf5e0d89a8196d68064931068eeceba48d041fea6e59c10ca631e809d7a1e WatchSource:0}: Error finding container 6fedf5e0d89a8196d68064931068eeceba48d041fea6e59c10ca631e809d7a1e: Status 404 returned error can't find the container with id 6fedf5e0d89a8196d68064931068eeceba48d041fea6e59c10ca631e809d7a1e
May 23 22:05:14.769041 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:05:14.769020    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78db2e6c_0f35_44b4_bad4_862d3df87bbc.slice/crio-8eef4db3fc0eb8f26a7d86be326ed8c34d068d15e2504e39bbe3ace58c556a88 WatchSource:0}: Error finding container 8eef4db3fc0eb8f26a7d86be326ed8c34d068d15e2504e39bbe3ace58c556a88: Status 404 returned error can't find the container with id 8eef4db3fc0eb8f26a7d86be326ed8c34d068d15e2504e39bbe3ace58c556a88
May 23 22:05:14.987687 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.987575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:14.987687 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:14.987641    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:14.987687 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987672    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:14.987958 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:15.987711092 +0000 UTC m=+3.108301263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:14.987958 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987757    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:14.987958 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987774    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:14.987958 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987787    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:14.987958 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:14.987824    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:15.98781305 +0000 UTC m=+3.108403237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:15.415219 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.415075    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-22 22:00:14 +0000 UTC" deadline="2028-03-02 05:52:05.418491672 +0000 UTC"
May 23 22:05:15.415219 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.415114    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15559h46m50.003382618s"
May 23 22:05:15.472902 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.472208    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:15.472902 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.472352    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:15.472902 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.472768    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:15.472902 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.472858    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:15.513246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.513198    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9cbft" event={"ID":"0ab5905c-3a59-4020-9eff-e9fd7377822f","Type":"ContainerStarted","Data":"730a8e546dd8f2e400ab4060490644afb8d4d0a0dfcf9284e362d4cdd1610638"}
May 23 22:05:15.518592 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.518562    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9m6t7" event={"ID":"3ff0be26-9ebe-4e5f-a250-c041d8255449","Type":"ContainerStarted","Data":"bf6b311f7d5a8ca9631e3ab8f575dae0ecf0abf549eb05f4eceefd343c3fd28d"}
May 23 22:05:15.533806 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.533768    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4r5c" event={"ID":"c1c377a3-3117-4b46-8acd-c9f3a3a96fca","Type":"ContainerStarted","Data":"6f2a4a317e3f03193dbd9db30819381ad322c9b2d869e5f24410bab31102fdce"}
May 23 22:05:15.547742 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.547689    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"8eef4db3fc0eb8f26a7d86be326ed8c34d068d15e2504e39bbe3ace58c556a88"}
May 23 22:05:15.561285 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.561219    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4p6j" event={"ID":"1a58fe25-a1fb-4489-b9fc-797a8634fcdc","Type":"ContainerStarted","Data":"6fedf5e0d89a8196d68064931068eeceba48d041fea6e59c10ca631e809d7a1e"}
May 23 22:05:15.563616 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.563550    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfbv6" event={"ID":"a2a87229-f96a-4186-aafb-5d663fc8aa01","Type":"ContainerStarted","Data":"f81c83f6c50a81b3d0cc061049cade82b555e17beee70f5ba4c88499acc66e5b"}
May 23 22:05:15.579801 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.579774    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerStarted","Data":"e3f7bacdbac9bcbc2f925d17bb2c557e9521a782f8266338f6d3c0e15527bdf0"}
May 23 22:05:15.587101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.587075    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kf9d" event={"ID":"2c5f355a-f160-4c7c-8d90-f01a17e78672","Type":"ContainerStarted","Data":"0c0f262b46462c77155633c4db7d823ae20072377ab168aea17ccd8cd7b69a41"}
May 23 22:05:15.595771 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.595747    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz" event={"ID":"120c0999-8d75-450b-845e-786d125b7617","Type":"ContainerStarted","Data":"140560db6db3c498e8d1e09864ac536f0bf46b3f56dc85959d4e79e45d3add0d"}
May 23 22:05:15.636619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.635894    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:15.780279 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.780207    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:15.812657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.812285    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 23 22:05:15.994916 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.994882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:15.995103 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:15.994950    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:15.995183 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995142    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:15.995240 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995204    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:17.995184174 +0000 UTC m=+5.115774350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:15.995610 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995592    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:15.995690 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995617    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:15.995690 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995629    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:15.995690 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:15.995680    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:17.995666086 +0000 UTC m=+5.116256260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:16.415619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:16.415546    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-22 22:00:14 +0000 UTC" deadline="2028-01-14 06:00:57.043938409 +0000 UTC"
May 23 22:05:16.415619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:16.415585    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14407h55m40.628356949s"
May 23 22:05:17.473921 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:17.471156    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:17.473921 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:17.471299    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:17.473921 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:17.472249    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:17.473921 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:17.472353    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:18.009830 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:18.009790    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:18.010034 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:18.009878    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:18.010034 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010013    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:18.010163 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010101    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:22.010079152 +0000 UTC m=+9.130669336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:18.010532 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010508    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:18.010532 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010534    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:18.010707 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010547    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:18.010707 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:18.010592    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:22.010576246 +0000 UTC m=+9.131166422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:19.471333 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:19.470862    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:19.471333 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:19.470987    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:19.471837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:19.470862    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:19.471837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:19.471485    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:21.471200 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:21.471128    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:21.471200 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:21.471156    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:21.471708 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:21.471274    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:21.471708 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:21.471372    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:22.043819 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:22.043790    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:22.044009 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:22.043850    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:22.044009 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.043975    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:22.044009 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.043991    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:22.044009 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.044003    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:22.044241 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.044075    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:30.044038315 +0000 UTC m=+17.164628498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:22.044496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.044410    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:22.044496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:22.044477    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:30.044460163 +0000 UTC m=+17.165050342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:23.472887 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:23.472670    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:23.472887 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:23.472779    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:23.472887 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:23.472831    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:23.473429 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:23.472927    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:25.471355 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:25.471278    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:25.471789 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:25.471279    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:25.471789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:25.471382    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:25.471789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:25.471473    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:27.471852 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:27.471813    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:27.472431 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:27.471817    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:27.472431 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:27.471967    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:27.472431 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:27.472020    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:29.471649 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:29.471611    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:29.472078 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:29.471669    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:29.472078 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:29.471759    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:29.472078 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:29.471844    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:30.104283 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:30.104236    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:30.104496 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:30.104319    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:30.104496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104400    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:30.104496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104452    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:30.104496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104468    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:30.104496 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104482    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:30.104685 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104470    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:46.104453474 +0000 UTC m=+33.225043660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:30.104685 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:30.104558    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:05:46.104533199 +0000 UTC m=+33.225123379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:31.471028 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:31.470991    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:31.471028 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:31.471011    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:31.471545 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:31.471133    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:31.471545 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:31.471238    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:33.474943 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:33.473642    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:33.474943 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:33.473807    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:33.474943 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:33.474273    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:33.474943 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:33.474394    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:33.632409 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:33.632382    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal" event={"ID":"2cb67e3ce093f11801888ffea920b426","Type":"ContainerStarted","Data":"d3da16f2946a55156a36ab80de5311973bf391f287e8dcc204285734643ea021"}
May 23 22:05:33.647675 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:33.647639    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-7.ec2.internal" podStartSLOduration=20.647624198 podStartE2EDuration="20.647624198s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:05:33.647021323 +0000 UTC m=+20.767611516" watchObservedRunningTime="2026-05-23 22:05:33.647624198 +0000 UTC m=+20.768214389"
May 23 22:05:34.641020 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.640632    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4p6j" event={"ID":"1a58fe25-a1fb-4489-b9fc-797a8634fcdc","Type":"ContainerStarted","Data":"8d50dca500d187beb17c8214476749d3dbf752dc7eb10d946d5149b8fb0822f5"}
May 23 22:05:34.642860 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.642835    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfbv6" event={"ID":"a2a87229-f96a-4186-aafb-5d663fc8aa01","Type":"ContainerStarted","Data":"54fae2ead20a3fa7d8d042ef6e069580cfc67ed31a9f406caa6be0baf139c93c"}
May 23 22:05:34.644463 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.644435    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerStarted","Data":"7b423dbeb94dbe34d773ec509c7aaf326ca21e7577034955e7cecaa27b03f124"}
May 23 22:05:34.646312 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.646290    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kf9d" event={"ID":"2c5f355a-f160-4c7c-8d90-f01a17e78672","Type":"ContainerStarted","Data":"2c04251a53720f383c60b76eefe01642d892ff8f1e98c40ea31a8f965289ff50"}
May 23 22:05:34.648546 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.648528    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz" event={"ID":"120c0999-8d75-450b-845e-786d125b7617","Type":"ContainerStarted","Data":"d7ded3d6a1ef9ea887c62571182781d02294ca50a8e5a18973d8a61aa0a77ae9"}
May 23 22:05:34.650074 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.649784    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9cbft" event={"ID":"0ab5905c-3a59-4020-9eff-e9fd7377822f","Type":"ContainerStarted","Data":"7cec7932f583e3b8d8786e2d20436c6745a072c3b60ede2a647e8ce6aca854ee"}
May 23 22:05:34.651249 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.651227    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9m6t7" event={"ID":"3ff0be26-9ebe-4e5f-a250-c041d8255449","Type":"ContainerStarted","Data":"686ec60f62a129644a3fd61eaaa1233d48a7a87de7835d0cd466499dbf551258"}
May 23 22:05:34.652832 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.652812    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4r5c" event={"ID":"c1c377a3-3117-4b46-8acd-c9f3a3a96fca","Type":"ContainerStarted","Data":"ea00640ea4d7393a17054fbe914eb593e672401258230085bc0c38cd6e54eb03"}
May 23 22:05:34.655134 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.655095    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n4p6j" podStartSLOduration=3.10918322 podStartE2EDuration="21.655084237s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.766075484 +0000 UTC m=+1.886665654" lastFinishedPulling="2026-05-23 22:05:33.311976491 +0000 UTC m=+20.432566671" observedRunningTime="2026-05-23 22:05:34.655027297 +0000 UTC m=+21.775617490" watchObservedRunningTime="2026-05-23 22:05:34.655084237 +0000 UTC m=+21.775674428"
May 23 22:05:34.655845 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.655828    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal" event={"ID":"efc60baa9b3e4f38f405fbfb0f4046d4","Type":"ContainerStarted","Data":"bd65a435d5f3cb5185fa90364a84a9f2e4076b8ddf984955cb6455806b6678f3"}
May 23 22:05:34.657980 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.657939    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:05:34.658215 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658197    2575 generic.go:358] "Generic (PLEG): container finished" podID="78db2e6c-0f35-44b4-bad4-862d3df87bbc" containerID="4bb6276abcd69a9989229287ef08feb468c7af7c28e1e96c9aafe5a6879eefa1" exitCode=1
May 23 22:05:34.658558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658485    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"4585a6ab49e7b0b80e88da8bf34263cd3b985f1899c9294a753def732f728163"}
May 23 22:05:34.658558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658505    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"27885794163ed72f20d421d3a6995b19130f1d1aebaf9a9d25ee6c5f5aa5abd4"}
May 23 22:05:34.658558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658514    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"12a2edb66a124d7873ade93dc47bb28f5aa4ba8f790226ebdd3e7350a7501b14"}
May 23 22:05:34.658558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658525    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerDied","Data":"4bb6276abcd69a9989229287ef08feb468c7af7c28e1e96c9aafe5a6879eefa1"}
May 23 22:05:34.658558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.658540    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"dfd23cd89df2319022ba9905cb32999ca2f1659dad8a921abc6a18ab9bf40387"}
May 23 22:05:34.673275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.673140    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zfbv6" podStartSLOduration=2.863409694 podStartE2EDuration="21.67312482s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.759172033 +0000 UTC m=+1.879762203" lastFinishedPulling="2026-05-23 22:05:33.568887145 +0000 UTC m=+20.689477329" observedRunningTime="2026-05-23 22:05:34.672954326 +0000 UTC m=+21.793544524" watchObservedRunningTime="2026-05-23 22:05:34.67312482 +0000 UTC m=+21.793715013"
May 23 22:05:34.689683 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.689471    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f4r5c" podStartSLOduration=3.025698298 podStartE2EDuration="21.689458353s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.70796258 +0000 UTC m=+1.828552750" lastFinishedPulling="2026-05-23 22:05:33.371722632 +0000 UTC m=+20.492312805" observedRunningTime="2026-05-23 22:05:34.68910818 +0000 UTC m=+21.809698373" watchObservedRunningTime="2026-05-23 22:05:34.689458353 +0000 UTC m=+21.810048544"
May 23 22:05:34.703918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.703851    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9m6t7" podStartSLOduration=3.048686933 podStartE2EDuration="21.703834795s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.714790825 +0000 UTC m=+1.835380995" lastFinishedPulling="2026-05-23 22:05:33.369938683 +0000 UTC m=+20.490528857" observedRunningTime="2026-05-23 22:05:34.70306864 +0000 UTC m=+21.823658827" watchObservedRunningTime="2026-05-23 22:05:34.703834795 +0000 UTC m=+21.824424988"
May 23 22:05:34.717455 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.717414    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5kf9d" podStartSLOduration=3.148586813 podStartE2EDuration="21.717398188s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.743160833 +0000 UTC m=+1.863751002" lastFinishedPulling="2026-05-23 22:05:33.31197219 +0000 UTC m=+20.432562377" observedRunningTime="2026-05-23 22:05:34.716986133 +0000 UTC m=+21.837576326" watchObservedRunningTime="2026-05-23 22:05:34.717398188 +0000 UTC m=+21.837988381"
May 23 22:05:34.732685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:34.732573    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9cbft" podStartSLOduration=7.504412701 podStartE2EDuration="21.732560388s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.747335029 +0000 UTC m=+1.867925198" lastFinishedPulling="2026-05-23 22:05:28.975482709 +0000 UTC m=+16.096072885" observedRunningTime="2026-05-23 22:05:34.73199799 +0000 UTC m=+21.852588182" watchObservedRunningTime="2026-05-23 22:05:34.732560388 +0000 UTC m=+21.853150599"
May 23 22:05:35.471350 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.471325    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:35.471498 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:35.471462    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:35.471498 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.471470    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:35.471695 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:35.471570    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:35.487721 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.485716    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 23 22:05:35.661978 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.661888    2575 generic.go:358] "Generic (PLEG): container finished" podID="efc60baa9b3e4f38f405fbfb0f4046d4" containerID="bd65a435d5f3cb5185fa90364a84a9f2e4076b8ddf984955cb6455806b6678f3" exitCode=0
May 23 22:05:35.661978 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.661963    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal" event={"ID":"efc60baa9b3e4f38f405fbfb0f4046d4","Type":"ContainerDied","Data":"bd65a435d5f3cb5185fa90364a84a9f2e4076b8ddf984955cb6455806b6678f3"}
May 23 22:05:35.662466 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.661986    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal" event={"ID":"efc60baa9b3e4f38f405fbfb0f4046d4","Type":"ContainerStarted","Data":"e41aad099711993d3af0d1f74458081f36310dc71b3dea0431dbfc633e668ff8"}
May 23 22:05:35.664330 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.664297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:05:35.664644 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.664626    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"e2ebcef6e9868009f627623892a11e4852e12b853e255ccacc71026ef536e701"}
May 23 22:05:35.665795 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.665771    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="7b423dbeb94dbe34d773ec509c7aaf326ca21e7577034955e7cecaa27b03f124" exitCode=0
May 23 22:05:35.665904 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.665838    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"7b423dbeb94dbe34d773ec509c7aaf326ca21e7577034955e7cecaa27b03f124"}
May 23 22:05:35.667494 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.667466    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz" event={"ID":"120c0999-8d75-450b-845e-786d125b7617","Type":"ContainerStarted","Data":"122178ab8fc14c5a77ad1dda9ec861208079b29690b736b77b40a04b9461af65"}
May 23 22:05:35.701808 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:35.701768    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-7.ec2.internal" podStartSLOduration=22.701757483 podStartE2EDuration="22.701757483s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:05:35.70130262 +0000 UTC m=+22.821892812" watchObservedRunningTime="2026-05-23 22:05:35.701757483 +0000 UTC m=+22.822347674"
May 23 22:05:36.441822 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:36.441722    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-23T22:05:35.485901357Z","UUID":"5babbf64-37f2-4ca5-8581-be1fce243346","Handler":null,"Name":"","Endpoint":""}
May 23 22:05:36.443988 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:36.443963    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 23 22:05:36.443988 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:36.443992    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 23 22:05:36.671080 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:36.671029    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz" event={"ID":"120c0999-8d75-450b-845e-786d125b7617","Type":"ContainerStarted","Data":"76e0bc4198c62ffbca72605999a0741e350064b9ccb9639d8c7192995f040fbc"}
May 23 22:05:37.471828 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:37.471788    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:37.472001 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:37.471915    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:37.472001 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:37.471977    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:37.472153 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:37.472096    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:37.675870 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:37.675837    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:05:37.676540 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:37.676229    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"4ee0e555220d091877b66c2fe14906cca5a728b7e9ba7ddb1fdc7731b6783db3"}
May 23 22:05:38.784111 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:38.784081    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:39.474462 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.474428    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:39.474623 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.474436    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:39.474623 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:39.474549    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:39.474748 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:39.474650    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:39.494225 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.494178    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:39.494792 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.494770    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:39.511293 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.511254    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntknz" podStartSLOduration=4.9743447320000005 podStartE2EDuration="26.511239961s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.693665194 +0000 UTC m=+1.814255364" lastFinishedPulling="2026-05-23 22:05:36.230560411 +0000 UTC m=+23.351150593" observedRunningTime="2026-05-23 22:05:36.688111978 +0000 UTC m=+23.808702170" watchObservedRunningTime="2026-05-23 22:05:39.511239961 +0000 UTC m=+26.631830156"
May 23 22:05:39.679845 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:39.679819    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9cbft"
May 23 22:05:40.683506 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.683332    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:05:40.683975 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.683818    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"d7b0d19ea07c232c20d2fcc2c895c57d1e5e4ebef4d693fc58d815215066eaf9"}
May 23 22:05:40.684144 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.684126    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:40.684221 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.684155    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:40.684282 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.684266    2575 scope.go:117] "RemoveContainer" containerID="4bb6276abcd69a9989229287ef08feb468c7af7c28e1e96c9aafe5a6879eefa1"
May 23 22:05:40.688275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.688249    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="e6c39c3f1a0f2f6d8fdd55eb5c7e90f93bd3a81f97f594da228abb65bc040fce" exitCode=0
May 23 22:05:40.688412 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.688312    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"e6c39c3f1a0f2f6d8fdd55eb5c7e90f93bd3a81f97f594da228abb65bc040fce"}
May 23 22:05:40.701808 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:40.701784    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:41.471570 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.471543    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:41.471703 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:41.471652    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:41.471740 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.471711    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:41.471839 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:41.471818    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:41.693282 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.693259    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:05:41.693647 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.693616    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" event={"ID":"78db2e6c-0f35-44b4-bad4-862d3df87bbc","Type":"ContainerStarted","Data":"b89686bd29d729523d83b1dd2e8d85ac16928abc92a3385a84259e654ca26855"}
May 23 22:05:41.694033 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.694013    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:41.708777 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.708749    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:05:41.722759 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.722218    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5" podStartSLOduration=9.393673369 podStartE2EDuration="28.722201924s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.770873358 +0000 UTC m=+1.891463528" lastFinishedPulling="2026-05-23 22:05:34.09940191 +0000 UTC m=+21.219992083" observedRunningTime="2026-05-23 22:05:41.720856606 +0000 UTC m=+28.841446799" watchObservedRunningTime="2026-05-23 22:05:41.722201924 +0000 UTC m=+28.842792118"
May 23 22:05:41.804790 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.804760    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86c5b"]
May 23 22:05:41.804908 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.804889    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:41.805018 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:41.804998    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:41.805355 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.805334    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d9hx9"]
May 23 22:05:41.805455 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:41.805434    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:41.805564 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:41.805538    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:42.696606 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:42.696431    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="209f3ad5939d387cccf2a20b70a2de3e8f185dc6e65e88ad90689fe8be8525ae" exitCode=0
May 23 22:05:42.696943 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:42.696519    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"209f3ad5939d387cccf2a20b70a2de3e8f185dc6e65e88ad90689fe8be8525ae"}
May 23 22:05:43.471860 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:43.471833    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:43.471943 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:43.471926    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:43.472009 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:43.471995    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:43.472112 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:43.472095    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:43.699969 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:43.699894    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="636c3e9f3b911b7e0e45cf3d5711a14f12015ed15b5be742f3848debd12f739e" exitCode=0
May 23 22:05:43.699969 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:43.699950    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"636c3e9f3b911b7e0e45cf3d5711a14f12015ed15b5be742f3848debd12f739e"}
May 23 22:05:45.471193 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:45.471163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:45.471636 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:45.471163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:45.471636 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:45.471308    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:05:45.471636 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:45.471339    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86c5b" podUID="23bb4542-3311-4344-a19b-075537fba37c"
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.125360    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.125476    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.125715    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.125812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:18.125781361 +0000 UTC m=+65.246371549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.126345    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.126373    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.126388    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kb7sl for pod openshift-network-diagnostics/network-check-target-86c5b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:46.127571 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.126441    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl podName:23bb4542-3311-4344-a19b-075537fba37c nodeName:}" failed. No retries permitted until 2026-05-23 22:06:18.126426253 +0000 UTC m=+65.247016437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7sl" (UniqueName: "kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl") pod "network-check-target-86c5b" (UID: "23bb4542-3311-4344-a19b-075537fba37c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 23 22:05:46.649690 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.649663    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-7.ec2.internal" event="NodeReady"
May 23 22:05:46.650160 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.649823    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 23 22:05:46.692964 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.692933    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cslgq"]
May 23 22:05:46.696880 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.696853    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nqmll"]
May 23 22:05:46.697065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.697024    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.699534 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.699513    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 23 22:05:46.699653 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.699539    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5kjmz\""
May 23 22:05:46.699701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.699684    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 23 22:05:46.700852 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.700834    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:46.702922 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.702902    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 23 22:05:46.703025 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.702962    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 23 22:05:46.703025 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.702983    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 23 22:05:46.703025 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.702990    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnn9s\""
May 23 22:05:46.705167 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.704891    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cslgq"]
May 23 22:05:46.707931 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.707911    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nqmll"]
May 23 22:05:46.830749 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.830894 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-config-volume\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.830894 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-tmp-dir\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.830894 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:46.830894 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4g68\" (UniqueName: \"kubernetes.io/projected/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-kube-api-access-v4g68\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.831033 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.830902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7rnw\" (UniqueName: \"kubernetes.io/projected/8553bc5b-9f0b-4332-a907-6a53c6868446-kube-api-access-z7rnw\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:46.932286 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932202    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-config-volume\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932286 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932240    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-tmp-dir\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932286 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932278    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:46.932570 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932299    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4g68\" (UniqueName: \"kubernetes.io/projected/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-kube-api-access-v4g68\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932570 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932325    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7rnw\" (UniqueName: \"kubernetes.io/projected/8553bc5b-9f0b-4332-a907-6a53c6868446-kube-api-access-z7rnw\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:46.932570 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.932493    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:05:46.932570 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.932552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:47.432536795 +0000 UTC m=+34.553126970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:05:46.932838 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932689    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932838 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932810    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-tmp-dir\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932838 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.932829    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:05:46.932968 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.932867    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-config-volume\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.932968 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:46.932887    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:47.432872311 +0000 UTC m=+34.553462494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:05:46.943819 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.943636    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4g68\" (UniqueName: \"kubernetes.io/projected/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-kube-api-access-v4g68\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:46.943949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:46.943762    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7rnw\" (UniqueName: \"kubernetes.io/projected/8553bc5b-9f0b-4332-a907-6a53c6868446-kube-api-access-z7rnw\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:47.436617 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.436580    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:47.436785 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.436638    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:47.436785 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:47.436729    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:05:47.436785 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:47.436762    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:05:47.436933 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:47.436806    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:48.436784531 +0000 UTC m=+35.557374705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:05:47.436933 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:47.436828    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:48.436817077 +0000 UTC m=+35.557407247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:05:47.471688 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.471660    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:05:47.471847 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.471660    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:05:47.474581 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.474559    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 23 22:05:47.474721 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.474562    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 23 22:05:47.475609 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.475589    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-624w8\""
May 23 22:05:47.475719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.475656    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h5srv\""
May 23 22:05:47.475719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:47.475694    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 23 22:05:48.443534 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:48.443500    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:48.444024 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:48.443597    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:48.444024 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:48.443678    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:05:48.444024 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:48.443739    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:50.443724073 +0000 UTC m=+37.564314248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:05:48.444024 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:48.443678    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:05:48.444024 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:48.443812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:50.443799354 +0000 UTC m=+37.564389532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:05:49.714603 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:49.714565    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="09400934fb371ae7ef8b3a2e93327b5d63f2c6c2036672af5dccffd9495c251a" exitCode=0
May 23 22:05:49.714926 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:49.714607    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"09400934fb371ae7ef8b3a2e93327b5d63f2c6c2036672af5dccffd9495c251a"}
May 23 22:05:50.458003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:50.457973    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:50.458206 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:50.458026    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:50.458206 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:50.458140    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:05:50.458206 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:50.458184    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:05:50.458206 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:50.458205    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:54.458186202 +0000 UTC m=+41.578776389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:05:50.458374 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:50.458234    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:05:54.45821906 +0000 UTC m=+41.578809244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:05:50.719438 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:50.719365    2575 generic.go:358] "Generic (PLEG): container finished" podID="cb04e5a7-5197-4a6e-9194-2b401f159673" containerID="2519c0557b5c2b413ab0859acb4279496c77f0225d3a4e46702735d45b591c70" exitCode=0
May 23 22:05:50.719438 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:50.719411    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerDied","Data":"2519c0557b5c2b413ab0859acb4279496c77f0225d3a4e46702735d45b591c70"}
May 23 22:05:51.723931 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:51.723848    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" event={"ID":"cb04e5a7-5197-4a6e-9194-2b401f159673","Type":"ContainerStarted","Data":"7890dae84b46c29369fdfd02bb30f11e9dd441547dc7dabbefcf73b8f2883851"}
May 23 22:05:51.748141 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:51.748096    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4qqxb" podStartSLOduration=4.198400345 podStartE2EDuration="38.748083543s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:05:14.754816237 +0000 UTC m=+1.875406406" lastFinishedPulling="2026-05-23 22:05:49.304499434 +0000 UTC m=+36.425089604" observedRunningTime="2026-05-23 22:05:51.746663833 +0000 UTC m=+38.867254025" watchObservedRunningTime="2026-05-23 22:05:51.748083543 +0000 UTC m=+38.868673735"
May 23 22:05:54.485284 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:54.485252    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:05:54.485692 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:05:54.485350    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:05:54.485692 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:54.485401    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:05:54.485692 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:54.485462    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:02.485446626 +0000 UTC m=+49.606036797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:05:54.485692 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:54.485466    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:05:54.485692 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:05:54.485517    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:02.485500161 +0000 UTC m=+49.606090345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:06:02.535704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:02.535664    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:06:02.535704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:02.535709    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:06:02.536371 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:02.535835    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:06:02.536371 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:02.535874    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:06:02.536371 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:02.535917    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:18.535895037 +0000 UTC m=+65.656485212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:06:02.536371 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:02.535937    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:18.535927932 +0000 UTC m=+65.656518108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:06:13.710184 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:13.710158    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwsp5"
May 23 22:06:18.142745 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.142703    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:06:18.143225 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.142766    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:06:18.145263 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.145246    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 23 22:06:18.145320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.145278    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 23 22:06:18.153184 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.153164    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 23 22:06:18.153269 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.153224    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:22.153209707 +0000 UTC m=+129.273799881 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : secret "metrics-daemon-secret" not found
May 23 22:06:18.155232 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.155218    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 23 22:06:18.167685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.167663    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7sl\" (UniqueName: \"kubernetes.io/projected/23bb4542-3311-4344-a19b-075537fba37c-kube-api-access-kb7sl\") pod \"network-check-target-86c5b\" (UID: \"23bb4542-3311-4344-a19b-075537fba37c\") " pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:06:18.392002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.391977    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-624w8\""
May 23 22:06:18.399861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.399819    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:06:18.546547 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.546520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:06:18.546668 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.546558    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:06:18.546709 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.546666    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:06:18.546745 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.546727    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:50.546710857 +0000 UTC m=+97.667301033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:06:18.546786 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.546668    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:06:18.546818 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:18.546796    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:06:50.546783611 +0000 UTC m=+97.667373784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:06:18.582907 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.582878    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86c5b"]
May 23 22:06:18.587387 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:06:18.587359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bb4542_3311_4344_a19b_075537fba37c.slice/crio-37c4b05bef1625a38c3ce92eca8fd7a6a71fe18afbc8bd0b25bf8d8566e1b96d WatchSource:0}: Error finding container 37c4b05bef1625a38c3ce92eca8fd7a6a71fe18afbc8bd0b25bf8d8566e1b96d: Status 404 returned error can't find the container with id 37c4b05bef1625a38c3ce92eca8fd7a6a71fe18afbc8bd0b25bf8d8566e1b96d
May 23 22:06:18.773715 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:18.773645    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86c5b" event={"ID":"23bb4542-3311-4344-a19b-075537fba37c","Type":"ContainerStarted","Data":"37c4b05bef1625a38c3ce92eca8fd7a6a71fe18afbc8bd0b25bf8d8566e1b96d"}
May 23 22:06:21.779793 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:21.779715    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86c5b" event={"ID":"23bb4542-3311-4344-a19b-075537fba37c","Type":"ContainerStarted","Data":"f62f47de48b7c6f122160af251833a7a5914078962cb5e8aa10ea253bc24a9ea"}
May 23 22:06:21.780149 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:21.779859    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:06:21.794635 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:21.794590    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-86c5b" podStartSLOduration=65.936770427 podStartE2EDuration="1m8.794577009s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:06:18.589126874 +0000 UTC m=+65.709717044" lastFinishedPulling="2026-05-23 22:06:21.44693344 +0000 UTC m=+68.567523626" observedRunningTime="2026-05-23 22:06:21.79435694 +0000 UTC m=+68.914947144" watchObservedRunningTime="2026-05-23 22:06:21.794577009 +0000 UTC m=+68.915167221"
May 23 22:06:50.560937 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:50.560888    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:06:50.560937 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:50.560943    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:06:50.561554 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:50.561043    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 23 22:06:50.561554 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:50.561074    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 23 22:06:50.561554 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:50.561118    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls podName:c26e358d-e1a7-4fbb-8ac8-12dc563321c8 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:54.561104477 +0000 UTC m=+161.681694646 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls") pod "dns-default-cslgq" (UID: "c26e358d-e1a7-4fbb-8ac8-12dc563321c8") : secret "dns-default-metrics-tls" not found
May 23 22:06:50.561554 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:06:50.561150    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert podName:8553bc5b-9f0b-4332-a907-6a53c6868446 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:54.561130859 +0000 UTC m=+161.681721041 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert") pod "ingress-canary-nqmll" (UID: "8553bc5b-9f0b-4332-a907-6a53c6868446") : secret "canary-serving-cert" not found
May 23 22:06:52.784175 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:06:52.784137    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-86c5b"
May 23 22:07:22.167001 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:22.166962    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:07:22.167490 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:22.167091    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 23 22:07:22.167490 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:22.167168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs podName:8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8 nodeName:}" failed. No retries permitted until 2026-05-23 22:09:24.16715395 +0000 UTC m=+251.287744120 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs") pod "network-metrics-daemon-d9hx9" (UID: "8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8") : secret "metrics-daemon-secret" not found
May 23 22:07:25.562829 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.562799    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"]
May 23 22:07:25.565876 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.565855    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.568345 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.568321    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rzxg5\""
May 23 22:07:25.569386 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.569369    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 23 22:07:25.569455 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.569400    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 23 22:07:25.569455 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.569372    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 23 22:07:25.572965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.572943    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"]
May 23 22:07:25.575538 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.575521    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-77d7b4dfd8-7pvr9"]
May 23 22:07:25.575858 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.575834    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"
May 23 22:07:25.578222 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.578203    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 23 22:07:25.578309 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.578205    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 23 22:07:25.578309 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.578269    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cl7pg\""
May 23 22:07:25.580967 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.580950    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"]
May 23 22:07:25.581088 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.581060    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.583543 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583370    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 23 22:07:25.583543 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583412    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 23 22:07:25.583701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583435    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 23 22:07:25.583701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583482    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 23 22:07:25.583701 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583607    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 23 22:07:25.583858 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583844    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 23 22:07:25.583945 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.583871    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bbngp\""
May 23 22:07:25.584992 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.584978    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"]
May 23 22:07:25.589514 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.589480    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77d7b4dfd8-7pvr9"]
May 23 22:07:25.674078 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.674036    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:07:25.676875 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.676856    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.679229 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.679206    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 23 22:07:25.679335 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.679239    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 23 22:07:25.679335 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.679325    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9j6m4\""
May 23 22:07:25.679498 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.679483    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 23 22:07:25.685680 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.685659    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 23 22:07:25.690168 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.690143    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:07:25.691874 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.691855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.691926 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.691887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbpk\" (UniqueName: \"kubernetes.io/projected/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-kube-api-access-rwbpk\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.691926 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.691914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnhp8\" (UniqueName: \"kubernetes.io/projected/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-kube-api-access-gnhp8\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.692002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.691957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-stats-auth\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.692002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.691974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.692097 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.692040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkwg\" (UniqueName: \"kubernetes.io/projected/146c8ad9-2a57-43dd-a51d-beb359d23c24-kube-api-access-mpkwg\") pod \"volume-data-source-validator-5cf8c89d64-hhn45\" (UID: \"146c8ad9-2a57-43dd-a51d-beb359d23c24\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"
May 23 22:07:25.692097 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.692084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.692172 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.692114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-default-certificate\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.792602 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792571    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkwg\" (UniqueName: \"kubernetes.io/projected/146c8ad9-2a57-43dd-a51d-beb359d23c24-kube-api-access-mpkwg\") pod \"volume-data-source-validator-5cf8c89d64-hhn45\" (UID: \"146c8ad9-2a57-43dd-a51d-beb359d23c24\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"
May 23 22:07:25.792602 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792601    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szd44\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792704    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-default-certificate\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.792761    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:26.29274224 +0000 UTC m=+133.413332448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : configmap references non-existent config key: service-ca.crt
May 23 22:07:25.792811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.792973    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.793010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.793025    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.793088    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbpk\" (UniqueName: \"kubernetes.io/projected/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-kube-api-access-rwbpk\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.793100    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls podName:9ac6aa4a-38a7-41fc-8c3f-7a9197b52544 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:26.293085837 +0000 UTC m=+133.413676013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls") pod "cluster-samples-operator-697587599-7t8hq" (UID: "9ac6aa4a-38a7-41fc-8c3f-7a9197b52544") : secret "samples-operator-tls" not found
May 23 22:07:25.793139 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.793136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnhp8\" (UniqueName: \"kubernetes.io/projected/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-kube-api-access-gnhp8\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.793512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.793170    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-stats-auth\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.793512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.793191    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.793512 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.793292    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 23 22:07:25.793512 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.793335    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:26.29331631 +0000 UTC m=+133.413906479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : secret "router-metrics-certs-default" not found
May 23 22:07:25.795278 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.795261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-default-certificate\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.795539 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.795524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-stats-auth\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.801362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.801333    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbpk\" (UniqueName: \"kubernetes.io/projected/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-kube-api-access-rwbpk\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:25.801483 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.801469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkwg\" (UniqueName: \"kubernetes.io/projected/146c8ad9-2a57-43dd-a51d-beb359d23c24-kube-api-access-mpkwg\") pod \"volume-data-source-validator-5cf8c89d64-hhn45\" (UID: \"146c8ad9-2a57-43dd-a51d-beb359d23c24\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"
May 23 22:07:25.801526 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.801507    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnhp8\" (UniqueName: \"kubernetes.io/projected/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-kube-api-access-gnhp8\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:25.884507 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.884484    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"
May 23 22:07:25.893582 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893693 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893670    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893757 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893694    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893757 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893718    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szd44\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893757 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893739    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893922 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.893761    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.893922 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.893857    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 23 22:07:25.893922 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.893874    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74fd66548c-gxkkj: secret "image-registry-tls" not found
May 23 22:07:25.894090 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:25.893933    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls podName:d0eb6602-11dc-4763-975f-279881acc273 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:26.393915623 +0000 UTC m=+133.514505810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls") pod "image-registry-74fd66548c-gxkkj" (UID: "d0eb6602-11dc-4763-975f-279881acc273") : secret "image-registry-tls" not found
May 23 22:07:25.894090 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.894017    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.894211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.894101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.894211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.894174    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.894792 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.894769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.895065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.895029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.896405 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.896337    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.896566 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.896546    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.902095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.902077    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:25.902307 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:25.902291    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szd44\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:26.004188 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.004159    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45"]
May 23 22:07:26.007388 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:26.007361    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146c8ad9_2a57_43dd_a51d_beb359d23c24.slice/crio-4ad1ac2bda5674adb9bfb2507909a63e5700918cc4a8c915f9f62f1d0dc0b58e WatchSource:0}: Error finding container 4ad1ac2bda5674adb9bfb2507909a63e5700918cc4a8c915f9f62f1d0dc0b58e: Status 404 returned error can't find the container with id 4ad1ac2bda5674adb9bfb2507909a63e5700918cc4a8c915f9f62f1d0dc0b58e
May 23 22:07:26.298900 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.298816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:26.298900 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.298873    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.298932    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.298951    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.298960    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.299008    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls podName:9ac6aa4a-38a7-41fc-8c3f-7a9197b52544 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:27.298992918 +0000 UTC m=+134.419583099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls") pod "cluster-samples-operator-697587599-7t8hq" (UID: "9ac6aa4a-38a7-41fc-8c3f-7a9197b52544") : secret "samples-operator-tls" not found
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.299021    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:27.299014942 +0000 UTC m=+134.419605112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : secret "router-metrics-certs-default" not found
May 23 22:07:26.299142 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.299084    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:27.299067559 +0000 UTC m=+134.419657748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : configmap references non-existent config key: service-ca.crt
May 23 22:07:26.399809 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.399774    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:26.399999 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.399944    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 23 22:07:26.399999 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.399963    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74fd66548c-gxkkj: secret "image-registry-tls" not found
May 23 22:07:26.400146 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:26.400034    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls podName:d0eb6602-11dc-4763-975f-279881acc273 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:27.400011504 +0000 UTC m=+134.520601677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls") pod "image-registry-74fd66548c-gxkkj" (UID: "d0eb6602-11dc-4763-975f-279881acc273") : secret "image-registry-tls" not found
May 23 22:07:26.897789 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:26.897754    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45" event={"ID":"146c8ad9-2a57-43dd-a51d-beb359d23c24","Type":"ContainerStarted","Data":"4ad1ac2bda5674adb9bfb2507909a63e5700918cc4a8c915f9f62f1d0dc0b58e"}
May 23 22:07:27.306496 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.306426    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:27.306496 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.306481    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.306560    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.306578    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.306618    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:29.306603793 +0000 UTC m=+136.427193967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : secret "router-metrics-certs-default" not found
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.306634    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.306691    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls podName:9ac6aa4a-38a7-41fc-8c3f-7a9197b52544 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:29.306684722 +0000 UTC m=+136.427274898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls") pod "cluster-samples-operator-697587599-7t8hq" (UID: "9ac6aa4a-38a7-41fc-8c3f-7a9197b52544") : secret "samples-operator-tls" not found
May 23 22:07:27.306789 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.306783    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:29.306770302 +0000 UTC m=+136.427360472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : configmap references non-existent config key: service-ca.crt
May 23 22:07:27.407492 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.407460    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:27.407621 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.407590    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 23 22:07:27.407621 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.407604    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74fd66548c-gxkkj: secret "image-registry-tls" not found
May 23 22:07:27.407700 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:27.407653    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls podName:d0eb6602-11dc-4763-975f-279881acc273 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:29.407635705 +0000 UTC m=+136.528225886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls") pod "image-registry-74fd66548c-gxkkj" (UID: "d0eb6602-11dc-4763-975f-279881acc273") : secret "image-registry-tls" not found
May 23 22:07:27.900873 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.900838    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45" event={"ID":"146c8ad9-2a57-43dd-a51d-beb359d23c24","Type":"ContainerStarted","Data":"7fc8a108f626b9ee2b4697ac0f60fd7f0058450175eab896d9de1cefb61ba0d0"}
May 23 22:07:27.916945 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:27.916810    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hhn45" podStartSLOduration=1.584322685 podStartE2EDuration="2.916796847s" podCreationTimestamp="2026-05-23 22:07:25 +0000 UTC" firstStartedPulling="2026-05-23 22:07:26.00915625 +0000 UTC m=+133.129746420" lastFinishedPulling="2026-05-23 22:07:27.341630397 +0000 UTC m=+134.462220582" observedRunningTime="2026-05-23 22:07:27.91642507 +0000 UTC m=+135.037015263" watchObservedRunningTime="2026-05-23 22:07:27.916796847 +0000 UTC m=+135.037387038"
May 23 22:07:29.321400 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:29.321343    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:29.321400 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:29.321409    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.321488    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.321519    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:33.32150575 +0000 UTC m=+140.442095920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : configmap references non-existent config key: service-ca.crt
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.321549    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:33.321534859 +0000 UTC m=+140.442125030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : secret "router-metrics-certs-default" not found
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:29.321583    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.321693    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 23 22:07:29.321837 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.321757    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls podName:9ac6aa4a-38a7-41fc-8c3f-7a9197b52544 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:33.321746053 +0000 UTC m=+140.442336227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls") pod "cluster-samples-operator-697587599-7t8hq" (UID: "9ac6aa4a-38a7-41fc-8c3f-7a9197b52544") : secret "samples-operator-tls" not found
May 23 22:07:29.422267 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:29.422228    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:29.422416 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.422330    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 23 22:07:29.422416 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.422341    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74fd66548c-gxkkj: secret "image-registry-tls" not found
May 23 22:07:29.422416 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:29.422384    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls podName:d0eb6602-11dc-4763-975f-279881acc273 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:33.422372145 +0000 UTC m=+140.542962315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls") pod "image-registry-74fd66548c-gxkkj" (UID: "d0eb6602-11dc-4763-975f-279881acc273") : secret "image-registry-tls" not found
May 23 22:07:32.590300 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:32.590271    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9m6t7_3ff0be26-9ebe-4e5f-a250-c041d8255449/dns-node-resolver/0.log"
May 23 22:07:33.351495 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:33.351459    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:33.351685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:33.351528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:33.351685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:33.351592    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:33.351685 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.351599    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 23 22:07:33.351685 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.351652    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:41.351637318 +0000 UTC m=+148.472227492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : secret "router-metrics-certs-default" not found
May 23 22:07:33.351846 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.351687    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle podName:26d79e61-a1b9-4fd1-a8c7-fe661f5d7719 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:41.351670861 +0000 UTC m=+148.472261032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle") pod "router-default-77d7b4dfd8-7pvr9" (UID: "26d79e61-a1b9-4fd1-a8c7-fe661f5d7719") : configmap references non-existent config key: service-ca.crt
May 23 22:07:33.351846 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.351691    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 23 22:07:33.351846 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.351723    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls podName:9ac6aa4a-38a7-41fc-8c3f-7a9197b52544 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:41.351716706 +0000 UTC m=+148.472306876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls") pod "cluster-samples-operator-697587599-7t8hq" (UID: "9ac6aa4a-38a7-41fc-8c3f-7a9197b52544") : secret "samples-operator-tls" not found
May 23 22:07:33.390030 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:33.390010    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kf9d_2c5f355a-f160-4c7c-8d90-f01a17e78672/node-ca/0.log"
May 23 22:07:33.452778 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:33.452754    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:33.452882 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.452837    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 23 22:07:33.452882 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.452847    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74fd66548c-gxkkj: secret "image-registry-tls" not found
May 23 22:07:33.452948 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:33.452896    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls podName:d0eb6602-11dc-4763-975f-279881acc273 nodeName:}" failed. No retries permitted until 2026-05-23 22:07:41.452883089 +0000 UTC m=+148.573473264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls") pod "image-registry-74fd66548c-gxkkj" (UID: "d0eb6602-11dc-4763-975f-279881acc273") : secret "image-registry-tls" not found
May 23 22:07:41.411599 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.411565    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:41.412037 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.411628    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:41.412037 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.411659    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:41.412283 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.412264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-service-ca-bundle\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:41.413982 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.413964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26d79e61-a1b9-4fd1-a8c7-fe661f5d7719-metrics-certs\") pod \"router-default-77d7b4dfd8-7pvr9\" (UID: \"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719\") " pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:41.414038 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.414023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9ac6aa4a-38a7-41fc-8c3f-7a9197b52544-samples-operator-tls\") pod \"cluster-samples-operator-697587599-7t8hq\" (UID: \"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:41.475123 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.475098    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"
May 23 22:07:41.491850 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.491827    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:41.513512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.513014    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:41.515983 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.515943    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"image-registry-74fd66548c-gxkkj\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") " pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:41.585704 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.585678    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:41.603709 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.603669    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq"]
May 23 22:07:41.625005 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.624975    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77d7b4dfd8-7pvr9"]
May 23 22:07:41.628149 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:41.628114    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d79e61_a1b9_4fd1_a8c7_fe661f5d7719.slice/crio-33a32d1eef58911572aa1fff63a29b1fc6b0b8d8fa0a212b86d8b6118cbc404a WatchSource:0}: Error finding container 33a32d1eef58911572aa1fff63a29b1fc6b0b8d8fa0a212b86d8b6118cbc404a: Status 404 returned error can't find the container with id 33a32d1eef58911572aa1fff63a29b1fc6b0b8d8fa0a212b86d8b6118cbc404a
May 23 22:07:41.716375 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.716346    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:07:41.719794 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:41.719771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0eb6602_11dc_4763_975f_279881acc273.slice/crio-0992153f9f549abdb76bcd7f89336e4ad99cece6680587d24da0d0cd85c57045 WatchSource:0}: Error finding container 0992153f9f549abdb76bcd7f89336e4ad99cece6680587d24da0d0cd85c57045: Status 404 returned error can't find the container with id 0992153f9f549abdb76bcd7f89336e4ad99cece6680587d24da0d0cd85c57045
May 23 22:07:41.928366 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.928289    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq" event={"ID":"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544","Type":"ContainerStarted","Data":"80e774b0a34290a575c4e4f04fc892a7db96a984ec620b5aceedfebbc8b2325b"}
May 23 22:07:41.929730 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.929703    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" event={"ID":"d0eb6602-11dc-4763-975f-279881acc273","Type":"ContainerStarted","Data":"e71a33deffcaba5ceb81898d82e0b247b4577a47e31d5b3038bdefac24db41b8"}
May 23 22:07:41.929871 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.929733    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" event={"ID":"d0eb6602-11dc-4763-975f-279881acc273","Type":"ContainerStarted","Data":"0992153f9f549abdb76bcd7f89336e4ad99cece6680587d24da0d0cd85c57045"}
May 23 22:07:41.929871 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.929810    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:07:41.930978 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.930957    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9" event={"ID":"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719","Type":"ContainerStarted","Data":"289f24e4118acfb14f056f2ac37d1302a34bcba430c35cb4aee542f94864c5fc"}
May 23 22:07:41.931084 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.930981    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9" event={"ID":"26d79e61-a1b9-4fd1-a8c7-fe661f5d7719","Type":"ContainerStarted","Data":"33a32d1eef58911572aa1fff63a29b1fc6b0b8d8fa0a212b86d8b6118cbc404a"}
May 23 22:07:41.948883 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.948845    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" podStartSLOduration=16.948833004 podStartE2EDuration="16.948833004s" podCreationTimestamp="2026-05-23 22:07:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:07:41.948295882 +0000 UTC m=+149.068886073" watchObservedRunningTime="2026-05-23 22:07:41.948833004 +0000 UTC m=+149.069423195"
May 23 22:07:41.965258 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:41.965209    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9" podStartSLOduration=16.965196205 podStartE2EDuration="16.965196205s" podCreationTimestamp="2026-05-23 22:07:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:07:41.964561804 +0000 UTC m=+149.085151996" watchObservedRunningTime="2026-05-23 22:07:41.965196205 +0000 UTC m=+149.085786402"
May 23 22:07:42.492998 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:42.492962    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:42.495368 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:42.495342    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:42.933211 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:42.933175    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:42.934242 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:42.934226    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-77d7b4dfd8-7pvr9"
May 23 22:07:43.940069 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:43.940020    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq" event={"ID":"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544","Type":"ContainerStarted","Data":"efe8cdfb862f486dc9447aa769e01fce578628fb2e47208c7f282c08e0934136"}
May 23 22:07:43.940448 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:43.940078    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq" event={"ID":"9ac6aa4a-38a7-41fc-8c3f-7a9197b52544","Type":"ContainerStarted","Data":"7f82c99a31a62514ba05a6641e9b3234367b76e28e0b2267052f82400b476977"}
May 23 22:07:43.957707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:43.957659    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-7t8hq" podStartSLOduration=17.123389804 podStartE2EDuration="18.95764414s" podCreationTimestamp="2026-05-23 22:07:25 +0000 UTC" firstStartedPulling="2026-05-23 22:07:41.657066933 +0000 UTC m=+148.777657107" lastFinishedPulling="2026-05-23 22:07:43.49132127 +0000 UTC m=+150.611911443" observedRunningTime="2026-05-23 22:07:43.956918749 +0000 UTC m=+151.077508941" watchObservedRunningTime="2026-05-23 22:07:43.95764414 +0000 UTC m=+151.078234333"
May 23 22:07:49.710161 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:49.710122    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cslgq" podUID="c26e358d-e1a7-4fbb-8ac8-12dc563321c8"
May 23 22:07:49.717249 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:49.717220    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nqmll" podUID="8553bc5b-9f0b-4332-a907-6a53c6868446"
May 23 22:07:49.954288 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:49.954256    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:07:49.954476 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:49.954257    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cslgq"
May 23 22:07:50.484041 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:07:50.484002    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d9hx9" podUID="8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8"
May 23 22:07:53.673590 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.673554    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"]
May 23 22:07:53.678371 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.678349    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.688264 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.688239    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p5x74"]
May 23 22:07:53.688570 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.688550    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 23 22:07:53.688653 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.688588    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8c6lx\""
May 23 22:07:53.691323 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.691307    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.694124 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.694103    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 23 22:07:53.694472 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.694454    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 23 22:07:53.694635 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.694527    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 23 22:07:53.694697 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.694680    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 23 22:07:53.694745 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.694736    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g8ml\""
May 23 22:07:53.699448 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.699429    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"]
May 23 22:07:53.700889 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.700873    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 23 22:07:53.709590 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.709529    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p5x74"]
May 23 22:07:53.738993 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.738972    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:07:53.773768 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.773743    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db86fd659-j7mmf"]
May 23 22:07:53.779065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.779029    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.790358 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.790334    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db86fd659-j7mmf"]
May 23 22:07:53.800202 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.800311 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b256ce02-37bd-4bc3-a314-341352cd9f23-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.800366 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm6pq\" (UniqueName: \"kubernetes.io/projected/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-api-access-lm6pq\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.800366 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f0d6982-a170-494c-9e63-6e94a02a1459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.800463 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b256ce02-37bd-4bc3-a314-341352cd9f23-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.800463 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f0d6982-a170-494c-9e63-6e94a02a1459-data-volume\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.800463 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.800444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f0d6982-a170-494c-9e63-6e94a02a1459-crio-socket\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.900743 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-ca-trust-extracted\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.900877 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-certificates\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.900877 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900776    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.900877 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-tls\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6h7\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-kube-api-access-9n6h7\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900962    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-image-registry-private-configuration\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.900988    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b256ce02-37bd-4bc3-a314-341352cd9f23-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901008    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm6pq\" (UniqueName: \"kubernetes.io/projected/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-api-access-lm6pq\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901033    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f0d6982-a170-494c-9e63-6e94a02a1459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901076    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f0d6982-a170-494c-9e63-6e94a02a1459-crio-socket\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-bound-sa-token\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-trusted-ca\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901147    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b256ce02-37bd-4bc3-a314-341352cd9f23-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.901178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901177    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f0d6982-a170-494c-9e63-6e94a02a1459-data-volume\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-installation-pull-secrets\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:53.901521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901315    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f0d6982-a170-494c-9e63-6e94a02a1459-crio-socket\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901473    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f0d6982-a170-494c-9e63-6e94a02a1459-data-volume\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.901775 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.901753    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b256ce02-37bd-4bc3-a314-341352cd9f23-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.903292 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.903271    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f0d6982-a170-494c-9e63-6e94a02a1459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.903396 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.903347    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b256ce02-37bd-4bc3-a314-341352cd9f23-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7462\" (UID: \"b256ce02-37bd-4bc3-a314-341352cd9f23\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:53.910662 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.910633    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm6pq\" (UniqueName: \"kubernetes.io/projected/0f0d6982-a170-494c-9e63-6e94a02a1459-kube-api-access-lm6pq\") pod \"insights-runtime-extractor-p5x74\" (UID: \"0f0d6982-a170-494c-9e63-6e94a02a1459\") " pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:53.986604 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:53.986553    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"
May 23 22:07:54.000157 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.000138    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p5x74"
May 23 22:07:54.001871 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.001851    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-bound-sa-token\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.001928 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.001900    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-trusted-ca\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.001966 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.001936    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-installation-pull-secrets\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002014 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.001977    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-ca-trust-extracted\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.002019    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-certificates\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.002067    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-tls\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.002094    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6h7\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-kube-api-access-9n6h7\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002257 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.002147    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-image-registry-private-configuration\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.002421 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.002398    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-ca-trust-extracted\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.003137 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.003094    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-certificates\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.003235 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.003180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-trusted-ca\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.005222 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.005178    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-installation-pull-secrets\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.005316 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.005260    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-registry-tls\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.006441 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.006393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-image-registry-private-configuration\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.010075 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.010029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-bound-sa-token\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.010543 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.010528    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6h7\" (UniqueName: \"kubernetes.io/projected/20be67b8-324d-4db2-a7f0-a6a6b992aaa5-kube-api-access-9n6h7\") pod \"image-registry-6db86fd659-j7mmf\" (UID: \"20be67b8-324d-4db2-a7f0-a6a6b992aaa5\") " pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.087762 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.087394    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.113328 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.113273    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7462"]
May 23 22:07:54.116707 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:54.116679    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb256ce02_37bd_4bc3_a314_341352cd9f23.slice/crio-23c8b7035b7af08fc815c7bdfb10a4e27232d697d467a5bf92756a96598d9141 WatchSource:0}: Error finding container 23c8b7035b7af08fc815c7bdfb10a4e27232d697d467a5bf92756a96598d9141: Status 404 returned error can't find the container with id 23c8b7035b7af08fc815c7bdfb10a4e27232d697d467a5bf92756a96598d9141
May 23 22:07:54.138029 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.137943    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p5x74"]
May 23 22:07:54.141230 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:54.141198    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0d6982_a170_494c_9e63_6e94a02a1459.slice/crio-39c6bc2ec048fab8a79edaf75dacdee633823e135ac388cf299cbad6b5f56134 WatchSource:0}: Error finding container 39c6bc2ec048fab8a79edaf75dacdee633823e135ac388cf299cbad6b5f56134: Status 404 returned error can't find the container with id 39c6bc2ec048fab8a79edaf75dacdee633823e135ac388cf299cbad6b5f56134
May 23 22:07:54.231346 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.231319    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db86fd659-j7mmf"]
May 23 22:07:54.233862 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:54.233839    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20be67b8_324d_4db2_a7f0_a6a6b992aaa5.slice/crio-a8ca1e8b8250630610b0bdc28794440fca2027251a75f16870410ca34a99ecb0 WatchSource:0}: Error finding container a8ca1e8b8250630610b0bdc28794440fca2027251a75f16870410ca34a99ecb0: Status 404 returned error can't find the container with id a8ca1e8b8250630610b0bdc28794440fca2027251a75f16870410ca34a99ecb0
May 23 22:07:54.608858 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.608816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:07:54.609228 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.608882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:07:54.611148 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.611123    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c26e358d-e1a7-4fbb-8ac8-12dc563321c8-metrics-tls\") pod \"dns-default-cslgq\" (UID: \"c26e358d-e1a7-4fbb-8ac8-12dc563321c8\") " pod="openshift-dns/dns-default-cslgq"
May 23 22:07:54.611272 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.611187    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8553bc5b-9f0b-4332-a907-6a53c6868446-cert\") pod \"ingress-canary-nqmll\" (UID: \"8553bc5b-9f0b-4332-a907-6a53c6868446\") " pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:07:54.757742 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.757671    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5kjmz\""
May 23 22:07:54.758580 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.758563    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnn9s\""
May 23 22:07:54.765580 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.765555    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cslgq"
May 23 22:07:54.765688 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.765650    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nqmll"
May 23 22:07:54.930568 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.930524    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cslgq"]
May 23 22:07:54.932836 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:54.932808    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26e358d_e1a7_4fbb_8ac8_12dc563321c8.slice/crio-8dc0c53378833625380cf35f46647f7aa31e347eee81d2c89b73b610502757c3 WatchSource:0}: Error finding container 8dc0c53378833625380cf35f46647f7aa31e347eee81d2c89b73b610502757c3: Status 404 returned error can't find the container with id 8dc0c53378833625380cf35f46647f7aa31e347eee81d2c89b73b610502757c3
May 23 22:07:54.939615 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.939591    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nqmll"]
May 23 22:07:54.942588 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:07:54.942563    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8553bc5b_9f0b_4332_a907_6a53c6868446.slice/crio-0fb705fcdc703af74ac8201c229b63015a057cfe63983c4f7ced5d591b21ffbc WatchSource:0}: Error finding container 0fb705fcdc703af74ac8201c229b63015a057cfe63983c4f7ced5d591b21ffbc: Status 404 returned error can't find the container with id 0fb705fcdc703af74ac8201c229b63015a057cfe63983c4f7ced5d591b21ffbc
May 23 22:07:54.971148 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.971115    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf" event={"ID":"20be67b8-324d-4db2-a7f0-a6a6b992aaa5","Type":"ContainerStarted","Data":"3c189c29662f25d64ae1773ce2cbdd5f57a4cf2076967a5307f8b7fde577b508"}
May 23 22:07:54.971246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.971152    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf" event={"ID":"20be67b8-324d-4db2-a7f0-a6a6b992aaa5","Type":"ContainerStarted","Data":"a8ca1e8b8250630610b0bdc28794440fca2027251a75f16870410ca34a99ecb0"}
May 23 22:07:54.971246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.971186    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:07:54.972800 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.972774    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5x74" event={"ID":"0f0d6982-a170-494c-9e63-6e94a02a1459","Type":"ContainerStarted","Data":"7b3efe5bb57fc329704b3fb3107e08ed8bc4654fe683054263bcc43d0dc8409e"}
May 23 22:07:54.972916 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.972809    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5x74" event={"ID":"0f0d6982-a170-494c-9e63-6e94a02a1459","Type":"ContainerStarted","Data":"39c6bc2ec048fab8a79edaf75dacdee633823e135ac388cf299cbad6b5f56134"}
May 23 22:07:54.973827 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.973799    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nqmll" event={"ID":"8553bc5b-9f0b-4332-a907-6a53c6868446","Type":"ContainerStarted","Data":"0fb705fcdc703af74ac8201c229b63015a057cfe63983c4f7ced5d591b21ffbc"}
May 23 22:07:54.975002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.974968    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cslgq" event={"ID":"c26e358d-e1a7-4fbb-8ac8-12dc563321c8","Type":"ContainerStarted","Data":"8dc0c53378833625380cf35f46647f7aa31e347eee81d2c89b73b610502757c3"}
May 23 22:07:54.976023 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.976001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462" event={"ID":"b256ce02-37bd-4bc3-a314-341352cd9f23","Type":"ContainerStarted","Data":"23c8b7035b7af08fc815c7bdfb10a4e27232d697d467a5bf92756a96598d9141"}
May 23 22:07:54.988950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:54.988901    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf" podStartSLOduration=1.988885491 podStartE2EDuration="1.988885491s" podCreationTimestamp="2026-05-23 22:07:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:07:54.987945262 +0000 UTC m=+162.108535455" watchObservedRunningTime="2026-05-23 22:07:54.988885491 +0000 UTC m=+162.109475679"
May 23 22:07:55.981370 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:55.981319    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462" event={"ID":"b256ce02-37bd-4bc3-a314-341352cd9f23","Type":"ContainerStarted","Data":"bffadefa6452ba024f306d7ab6231617e1219e5f29cc32779b5724433ec831e5"}
May 23 22:07:55.984742 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:55.984712    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5x74" event={"ID":"0f0d6982-a170-494c-9e63-6e94a02a1459","Type":"ContainerStarted","Data":"f57e7081e237a4bf0aee4829cbf69e8972893739554247a3b414f818ad224a36"}
May 23 22:07:55.998669 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:55.998296    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7462" podStartSLOduration=1.729958643 podStartE2EDuration="2.998278517s" podCreationTimestamp="2026-05-23 22:07:53 +0000 UTC" firstStartedPulling="2026-05-23 22:07:54.119083812 +0000 UTC m=+161.239673982" lastFinishedPulling="2026-05-23 22:07:55.387403673 +0000 UTC m=+162.507993856" observedRunningTime="2026-05-23 22:07:55.996328284 +0000 UTC m=+163.116918477" watchObservedRunningTime="2026-05-23 22:07:55.998278517 +0000 UTC m=+163.118868710"
May 23 22:07:57.991464 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:57.991425    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p5x74" event={"ID":"0f0d6982-a170-494c-9e63-6e94a02a1459","Type":"ContainerStarted","Data":"33c8891cb49967b79e207b70c1afc611e7b51db51488acd1c35e94e0b1baf5a0"}
May 23 22:07:57.992809 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:57.992786    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nqmll" event={"ID":"8553bc5b-9f0b-4332-a907-6a53c6868446","Type":"ContainerStarted","Data":"829116984c064ece48368ee431151364aece4e5240c0284eecfdb9df7d7ec6e5"}
May 23 22:07:57.994189 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:57.994171    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cslgq" event={"ID":"c26e358d-e1a7-4fbb-8ac8-12dc563321c8","Type":"ContainerStarted","Data":"8617c958b08a0bcfccc8b815ac42496890b6d3c9c1b4edabe1b43b85ed988c9d"}
May 23 22:07:57.994276 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:57.994191    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cslgq" event={"ID":"c26e358d-e1a7-4fbb-8ac8-12dc563321c8","Type":"ContainerStarted","Data":"cafe1aa8fa29e280eb63d93411f9f84febb5f0882f577724adc3376de33bdb77"}
May 23 22:07:57.994312 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:57.994285    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cslgq"
May 23 22:07:58.008244 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:58.008204    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p5x74" podStartSLOduration=1.82269467 podStartE2EDuration="5.008192853s" podCreationTimestamp="2026-05-23 22:07:53 +0000 UTC" firstStartedPulling="2026-05-23 22:07:54.197013023 +0000 UTC m=+161.317603207" lastFinishedPulling="2026-05-23 22:07:57.382511216 +0000 UTC m=+164.503101390" observedRunningTime="2026-05-23 22:07:58.007883689 +0000 UTC m=+165.128473881" watchObservedRunningTime="2026-05-23 22:07:58.008192853 +0000 UTC m=+165.128783044"
May 23 22:07:58.023497 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:58.023454    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nqmll" podStartSLOduration=129.5823473 podStartE2EDuration="2m12.023442578s" podCreationTimestamp="2026-05-23 22:05:46 +0000 UTC" firstStartedPulling="2026-05-23 22:07:54.944755378 +0000 UTC m=+162.065345551" lastFinishedPulling="2026-05-23 22:07:57.385850659 +0000 UTC m=+164.506440829" observedRunningTime="2026-05-23 22:07:58.022538733 +0000 UTC m=+165.143128924" watchObservedRunningTime="2026-05-23 22:07:58.023442578 +0000 UTC m=+165.144032813"
May 23 22:07:58.040131 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:07:58.040090    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cslgq" podStartSLOduration=129.593182537 podStartE2EDuration="2m12.040077302s" podCreationTimestamp="2026-05-23 22:05:46 +0000 UTC" firstStartedPulling="2026-05-23 22:07:54.935258732 +0000 UTC m=+162.055848907" lastFinishedPulling="2026-05-23 22:07:57.382153497 +0000 UTC m=+164.502743672" observedRunningTime="2026-05-23 22:07:58.039831723 +0000 UTC m=+165.160421915" watchObservedRunningTime="2026-05-23 22:07:58.040077302 +0000 UTC m=+165.160667495"
May 23 22:08:00.459114 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.459079    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"]
May 23 22:08:00.463034 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.463014    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:00.465318 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.465293    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 23 22:08:00.465480 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.465462    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-plnzc\""
May 23 22:08:00.471106 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.471084    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"]
May 23 22:08:00.556313 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.556286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf\" (UID: \"706f70be-3caa-449e-841b-4b709b57a14a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:00.657700 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:00.657662    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf\" (UID: \"706f70be-3caa-449e-841b-4b709b57a14a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:00.657856 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:00.657788    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 23 22:08:00.657856 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:00.657844    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates podName:706f70be-3caa-449e-841b-4b709b57a14a nodeName:}" failed. No retries permitted until 2026-05-23 22:08:01.157829129 +0000 UTC m=+168.278419299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf" (UID: "706f70be-3caa-449e-841b-4b709b57a14a") : secret "prometheus-operator-admission-webhook-tls" not found
May 23 22:08:01.161112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:01.161038    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf\" (UID: \"706f70be-3caa-449e-841b-4b709b57a14a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:01.163523 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:01.163498    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/706f70be-3caa-449e-841b-4b709b57a14a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf\" (UID: \"706f70be-3caa-449e-841b-4b709b57a14a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:01.372221 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:01.372185    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:01.471976 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:01.471939    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:08:01.490848 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:01.490819    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"]
May 23 22:08:01.494923 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:01.494892    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706f70be_3caa_449e_841b_4b709b57a14a.slice/crio-6898217eb94824d75e046606cc43bf2aa4b42723fc2446edf86aa595fe138921 WatchSource:0}: Error finding container 6898217eb94824d75e046606cc43bf2aa4b42723fc2446edf86aa595fe138921: Status 404 returned error can't find the container with id 6898217eb94824d75e046606cc43bf2aa4b42723fc2446edf86aa595fe138921
May 23 22:08:02.005329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:02.005293    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf" event={"ID":"706f70be-3caa-449e-841b-4b709b57a14a","Type":"ContainerStarted","Data":"6898217eb94824d75e046606cc43bf2aa4b42723fc2446edf86aa595fe138921"}
May 23 22:08:03.008700 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:03.008613    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf" event={"ID":"706f70be-3caa-449e-841b-4b709b57a14a","Type":"ContainerStarted","Data":"11bd275dc74eda4162eb22df9e0202912ec74210c17c096f50fd4d6ddd59bd3d"}
May 23 22:08:03.009135 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:03.008777    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:03.014033 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:03.014006    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf"
May 23 22:08:03.025228 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:03.025192    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf" podStartSLOduration=1.8914399610000001 podStartE2EDuration="3.025179012s" podCreationTimestamp="2026-05-23 22:08:00 +0000 UTC" firstStartedPulling="2026-05-23 22:08:01.496890385 +0000 UTC m=+168.617480570" lastFinishedPulling="2026-05-23 22:08:02.630629445 +0000 UTC m=+169.751219621" observedRunningTime="2026-05-23 22:08:03.025075434 +0000 UTC m=+170.145665628" watchObservedRunningTime="2026-05-23 22:08:03.025179012 +0000 UTC m=+170.145769204"
May 23 22:08:03.743637 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:03.743612    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:08:07.862978 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.862943    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:07.866118 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.866103    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:07.869752 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869727    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 23 22:08:07.869869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869761    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hs8tb\""
May 23 22:08:07.869869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869778    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 23 22:08:07.869869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869742    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 23 22:08:07.869869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869762    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 23 22:08:07.869869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.869868    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 23 22:08:07.870155 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.870019    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 23 22:08:07.870275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.870260    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 23 22:08:07.873978 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.873957    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 23 22:08:07.876618 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.876570    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:07.999619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:07.999591    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cslgq"
May 23 22:08:08.012965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.012939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.012965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.012983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.013012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013261 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.013121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcpnz\" (UniqueName: \"kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013261 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.013163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.013261 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.013188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114322 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114240    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114322 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114280    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114322 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114304    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114571 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114397    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114622 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114584    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcpnz\" (UniqueName: \"kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114635    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.114673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.114666    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.115167 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.115144    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.115334 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.115309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.115334 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.115190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.115473 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.115314    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.116892 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.116873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.116944 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.116881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.122653 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.122631    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcpnz\" (UniqueName: \"kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz\") pod \"console-7d5b5db7f6-qmsth\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") " pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.175611 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.175586    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:08.294259 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:08.294232    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:08.297237 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:08.297208    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac015aa_68d0_4b44_9654_890e2cd74c28.slice/crio-6eaa5d660846bda2b9bfe0702b770506019a6aed1f37232d54ca1b0ac79b6449 WatchSource:0}: Error finding container 6eaa5d660846bda2b9bfe0702b770506019a6aed1f37232d54ca1b0ac79b6449: Status 404 returned error can't find the container with id 6eaa5d660846bda2b9bfe0702b770506019a6aed1f37232d54ca1b0ac79b6449
May 23 22:08:09.027566 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:09.027522    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5b5db7f6-qmsth" event={"ID":"2ac015aa-68d0-4b44-9654-890e2cd74c28","Type":"ContainerStarted","Data":"6eaa5d660846bda2b9bfe0702b770506019a6aed1f37232d54ca1b0ac79b6449"}
May 23 22:08:11.034080 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:11.033992    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5b5db7f6-qmsth" event={"ID":"2ac015aa-68d0-4b44-9654-890e2cd74c28","Type":"ContainerStarted","Data":"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"}
May 23 22:08:11.059237 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:11.059188    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d5b5db7f6-qmsth" podStartSLOduration=1.5757366350000002 podStartE2EDuration="4.059174557s" podCreationTimestamp="2026-05-23 22:08:07 +0000 UTC" firstStartedPulling="2026-05-23 22:08:08.299119845 +0000 UTC m=+175.419710019" lastFinishedPulling="2026-05-23 22:08:10.782557759 +0000 UTC m=+177.903147941" observedRunningTime="2026-05-23 22:08:11.057458337 +0000 UTC m=+178.178048540" watchObservedRunningTime="2026-05-23 22:08:11.059174557 +0000 UTC m=+178.179764749"
May 23 22:08:14.921287 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.921257    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dc2cx"]
May 23 22:08:14.925925 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.925906    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:14.928837 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.928812    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 23 22:08:14.928954 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.928907    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 23 22:08:14.929349 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.929322    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 23 22:08:14.929895 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.929882    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 23 22:08:14.930043 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.930027    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 23 22:08:14.930043 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.930039    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 23 22:08:14.930199 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:14.930068    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vbmh6\""
May 23 22:08:15.070224 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-metrics-client-ca\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070224 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-tls\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-textfile\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5q2\" (UniqueName: \"kubernetes.io/projected/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-kube-api-access-zq5q2\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-wtmp\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-sys\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070449 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-root\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.070824 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.070480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171644    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-sys\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171672    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171698    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-root\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171723    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-sys\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171773    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-root\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171835    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-metrics-client-ca\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171859    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-tls\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171882    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-textfile\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171899    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5q2\" (UniqueName: \"kubernetes.io/projected/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-kube-api-access-zq5q2\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.171933 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.171924    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-wtmp\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.172376 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.172090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-wtmp\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.172376 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.172214    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-textfile\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.172376 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.172354    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.172517 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.172375    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-metrics-client-ca\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.174065 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.174033    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-tls\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.174171 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.174082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.180895 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.180873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5q2\" (UniqueName: \"kubernetes.io/projected/cbc683f8-1ba6-49d3-ab57-80ad682a53e6-kube-api-access-zq5q2\") pod \"node-exporter-dc2cx\" (UID: \"cbc683f8-1ba6-49d3-ab57-80ad682a53e6\") " pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.234825 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.234804    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dc2cx"
May 23 22:08:15.242661 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:15.242639    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc683f8_1ba6_49d3_ab57_80ad682a53e6.slice/crio-a2287e6a4326e39a3ec4636b64da0823f306ec1c84d4fba0f012891d817c4857 WatchSource:0}: Error finding container a2287e6a4326e39a3ec4636b64da0823f306ec1c84d4fba0f012891d817c4857: Status 404 returned error can't find the container with id a2287e6a4326e39a3ec4636b64da0823f306ec1c84d4fba0f012891d817c4857
May 23 22:08:15.988974 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:15.988947    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db86fd659-j7mmf"
May 23 22:08:16.022200 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.022171    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 23 22:08:16.026965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.026898    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.030941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030739    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 23 22:08:16.030941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030807    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 23 22:08:16.030941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030836    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 23 22:08:16.030941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030847    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 23 22:08:16.030941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030921    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 23 22:08:16.031329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.030956    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tr2ng\""
May 23 22:08:16.031329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.031132    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 23 22:08:16.031329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.031177    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 23 22:08:16.031329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.031183    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 23 22:08:16.031504 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.031410    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 23 22:08:16.041899 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.041873    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 23 22:08:16.048406 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.048369    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc2cx" event={"ID":"cbc683f8-1ba6-49d3-ab57-80ad682a53e6","Type":"ContainerStarted","Data":"a2287e6a4326e39a3ec4636b64da0823f306ec1c84d4fba0f012891d817c4857"}
May 23 22:08:16.179610 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179720 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179720 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179720 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwx4\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-kube-api-access-knwx4\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-web-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.179861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.180133 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.180133 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.180133 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.180133 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.179999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-config-out\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.180332 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.180143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281042 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.280980    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281042 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281014    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281042 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281034    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281252 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281170    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knwx4\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-kube-api-access-knwx4\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281252 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281206    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281351 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281229    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-web-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281351 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281281    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281351 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281309    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281351 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:16.281335    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 23 22:08:16.281528 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:16.281401    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls podName:4c73d02a-eed8-4e38-956a-302dd67b6326 nodeName:}" failed. No retries permitted until 2026-05-23 22:08:16.781380491 +0000 UTC m=+183.901970664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4c73d02a-eed8-4e38-956a-302dd67b6326") : secret "alertmanager-main-tls" not found
May 23 22:08:16.281598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281337    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281698 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281604    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281698 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281637    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281698 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281668    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-config-out\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281839 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281750    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.281909 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.281888    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.282466 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.282422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.283893 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.283849    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c73d02a-eed8-4e38-956a-302dd67b6326-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284070 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284214 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284194    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284690 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284623    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284810 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284781    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284864    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.284959 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.284930    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.285419 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.285396    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c73d02a-eed8-4e38-956a-302dd67b6326-config-out\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.286300 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.286279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-web-config\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.297527 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.297507    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwx4\" (UniqueName: \"kubernetes.io/projected/4c73d02a-eed8-4e38-956a-302dd67b6326-kube-api-access-knwx4\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.784867 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:16.784827    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:16.785076 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:16.784958    2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 23 22:08:16.785076 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:16.785026    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls podName:4c73d02a-eed8-4e38-956a-302dd67b6326 nodeName:}" failed. No retries permitted until 2026-05-23 22:08:17.785006149 +0000 UTC m=+184.905596334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4c73d02a-eed8-4e38-956a-302dd67b6326") : secret "alertmanager-main-tls" not found
May 23 22:08:17.056771 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.056672    2575 generic.go:358] "Generic (PLEG): container finished" podID="cbc683f8-1ba6-49d3-ab57-80ad682a53e6" containerID="db2558f434aed19736d4e772029bdb012a3c0c8fa02377a085c47bcb4f8f80ec" exitCode=0
May 23 22:08:17.056771 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.056733    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc2cx" event={"ID":"cbc683f8-1ba6-49d3-ab57-80ad682a53e6","Type":"ContainerDied","Data":"db2558f434aed19736d4e772029bdb012a3c0c8fa02377a085c47bcb4f8f80ec"}
May 23 22:08:17.792605 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.792569    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:17.794972 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.794944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c73d02a-eed8-4e38-956a-302dd67b6326-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c73d02a-eed8-4e38-956a-302dd67b6326\") " pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:17.840001 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.839978    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 23 22:08:17.998987 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:17.998964    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 23 22:08:18.001380 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:18.001339    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c73d02a_eed8_4e38_956a_302dd67b6326.slice/crio-9b212367a7309dcc7e88a6e7325d9e1c04aa5cfe1919310282e910137f72595a WatchSource:0}: Error finding container 9b212367a7309dcc7e88a6e7325d9e1c04aa5cfe1919310282e910137f72595a: Status 404 returned error can't find the container with id 9b212367a7309dcc7e88a6e7325d9e1c04aa5cfe1919310282e910137f72595a
May 23 22:08:18.061378 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.061286    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc2cx" event={"ID":"cbc683f8-1ba6-49d3-ab57-80ad682a53e6","Type":"ContainerStarted","Data":"fe1d1fb2b4d22add57388cdd903efba176e26baa590716f1791791338b78c176"}
May 23 22:08:18.061378 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.061331    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dc2cx" event={"ID":"cbc683f8-1ba6-49d3-ab57-80ad682a53e6","Type":"ContainerStarted","Data":"4c783a89250d56e5158687340842b5574c0e6b8584001186b20e387c9831bb9e"}
May 23 22:08:18.062377 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.062357    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"9b212367a7309dcc7e88a6e7325d9e1c04aa5cfe1919310282e910137f72595a"}
May 23 22:08:18.096131 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.096086    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dc2cx" podStartSLOduration=3.1792564309999998 podStartE2EDuration="4.096074192s" podCreationTimestamp="2026-05-23 22:08:14 +0000 UTC" firstStartedPulling="2026-05-23 22:08:15.244423755 +0000 UTC m=+182.365013925" lastFinishedPulling="2026-05-23 22:08:16.161241507 +0000 UTC m=+183.281831686" observedRunningTime="2026-05-23 22:08:18.095388659 +0000 UTC m=+185.215978851" watchObservedRunningTime="2026-05-23 22:08:18.096074192 +0000 UTC m=+185.216664380"
May 23 22:08:18.176595 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.176573    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:18.176595 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.176597    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:18.181632 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.181603    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:18.760304 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:18.760253    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" podUID="d0eb6602-11dc-4763-975f-279881acc273" containerName="registry" containerID="cri-o://e71a33deffcaba5ceb81898d82e0b247b4577a47e31d5b3038bdefac24db41b8" gracePeriod=30
May 23 22:08:19.066409 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.066377    2575 generic.go:358] "Generic (PLEG): container finished" podID="d0eb6602-11dc-4763-975f-279881acc273" containerID="e71a33deffcaba5ceb81898d82e0b247b4577a47e31d5b3038bdefac24db41b8" exitCode=0
May 23 22:08:19.066825 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.066454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" event={"ID":"d0eb6602-11dc-4763-975f-279881acc273","Type":"ContainerDied","Data":"e71a33deffcaba5ceb81898d82e0b247b4577a47e31d5b3038bdefac24db41b8"}
May 23 22:08:19.071662 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.071640    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:19.153636 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.153616    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:08:19.207260 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207233    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207265    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207291    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207345    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207505 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207379    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207505 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207425    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207505 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207462    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szd44\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207505 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207494    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") pod \"d0eb6602-11dc-4763-975f-279881acc273\" (UID: \"d0eb6602-11dc-4763-975f-279881acc273\") "
May 23 22:08:19.207850 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207797    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:19.208003 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.207960    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:19.208126 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.208042    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-registry-certificates\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.209726 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.209698    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:08:19.209819 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.209767    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:08:19.209890 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.209856    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:08:19.210018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.210000    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:08:19.210179 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.210159    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44" (OuterVolumeSpecName: "kube-api-access-szd44") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "kube-api-access-szd44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:08:19.216643 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.216621    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d0eb6602-11dc-4763-975f-279881acc273" (UID: "d0eb6602-11dc-4763-975f-279881acc273"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 23 22:08:19.234314 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.234293    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8577d958c-dsq25"]
May 23 22:08:19.234582 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.234569    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0eb6602-11dc-4763-975f-279881acc273" containerName="registry"
May 23 22:08:19.234620 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.234584    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0eb6602-11dc-4763-975f-279881acc273" containerName="registry"
May 23 22:08:19.234653 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.234644    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0eb6602-11dc-4763-975f-279881acc273" containerName="registry"
May 23 22:08:19.239127 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.239113    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.241846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241754    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 23 22:08:19.241846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241764    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3clej6r4b1jus\""
May 23 22:08:19.241846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241804    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 23 22:08:19.241846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241814    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 23 22:08:19.241846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241816    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4gxj7\""
May 23 22:08:19.242163 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.241807    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 23 22:08:19.248191 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.248171    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8577d958c-dsq25"]
May 23 22:08:19.308719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-metrics-server-audit-profiles\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zjct\" (UniqueName: \"kubernetes.io/projected/b1039fbf-337f-493b-9a32-1cdb43018dca-kube-api-access-4zjct\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308872 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-client-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308872 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-tls\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1039fbf-337f-493b-9a32-1cdb43018dca-audit-log\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-client-certs\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.308949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308947    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-registry-tls\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308957    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0eb6602-11dc-4763-975f-279881acc273-ca-trust-extracted\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308966    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-bound-sa-token\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308976    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-image-registry-private-configuration\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308987    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0eb6602-11dc-4763-975f-279881acc273-installation-pull-secrets\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.308995    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0eb6602-11dc-4763-975f-279881acc273-trusted-ca\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.309071 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.309004    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szd44\" (UniqueName: \"kubernetes.io/projected/d0eb6602-11dc-4763-975f-279881acc273-kube-api-access-szd44\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:19.409645 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409612    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-client-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409776 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409665    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-tls\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409776 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409699    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1039fbf-337f-493b-9a32-1cdb43018dca-audit-log\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409776 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409717    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-client-certs\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409776 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409737    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409776 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409761    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-metrics-server-audit-profiles\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.409999 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.409800    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zjct\" (UniqueName: \"kubernetes.io/projected/b1039fbf-337f-493b-9a32-1cdb43018dca-kube-api-access-4zjct\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.410243 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.410223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1039fbf-337f-493b-9a32-1cdb43018dca-audit-log\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.410451 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.410431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.410941 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.410921    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1039fbf-337f-493b-9a32-1cdb43018dca-metrics-server-audit-profiles\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.412207 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.412190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-tls\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.412551 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.412531    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-client-ca-bundle\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.412609 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.412564    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1039fbf-337f-493b-9a32-1cdb43018dca-secret-metrics-server-client-certs\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.421290 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.421274    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zjct\" (UniqueName: \"kubernetes.io/projected/b1039fbf-337f-493b-9a32-1cdb43018dca-kube-api-access-4zjct\") pod \"metrics-server-8577d958c-dsq25\" (UID: \"b1039fbf-337f-493b-9a32-1cdb43018dca\") " pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.548524 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.548496    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:19.684284 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.682300    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8577d958c-dsq25"]
May 23 22:08:19.689615 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.689589    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"]
May 23 22:08:19.694119 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.694100    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:19.696358 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.696341    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 23 22:08:19.696460 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.696450    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-4v6km\""
May 23 22:08:19.702167 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.702146    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"]
May 23 22:08:19.711983 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.711953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xgj2b\" (UID: \"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:19.813129 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:19.813090    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xgj2b\" (UID: \"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:19.813250 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:19.813230    2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 23 22:08:19.813301 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:19.813290    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert podName:41d7b6b6-c0b7-4701-ab1c-9e87787ec57e nodeName:}" failed. No retries permitted until 2026-05-23 22:08:20.313275673 +0000 UTC m=+187.433865848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-xgj2b" (UID: "41d7b6b6-c0b7-4701-ab1c-9e87787ec57e") : secret "monitoring-plugin-cert" not found
May 23 22:08:20.070205 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.070110    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj" event={"ID":"d0eb6602-11dc-4763-975f-279881acc273","Type":"ContainerDied","Data":"0992153f9f549abdb76bcd7f89336e4ad99cece6680587d24da0d0cd85c57045"}
May 23 22:08:20.070205 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.070119    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd66548c-gxkkj"
May 23 22:08:20.070205 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.070162    2575 scope.go:117] "RemoveContainer" containerID="e71a33deffcaba5ceb81898d82e0b247b4577a47e31d5b3038bdefac24db41b8"
May 23 22:08:20.071515 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.071489    2575 generic.go:358] "Generic (PLEG): container finished" podID="4c73d02a-eed8-4e38-956a-302dd67b6326" containerID="43193c14863c38b9fa27b825b61f3d0f0e558ded1ce91a2e90b3a4598f944903" exitCode=0
May 23 22:08:20.071586 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.071557    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerDied","Data":"43193c14863c38b9fa27b825b61f3d0f0e558ded1ce91a2e90b3a4598f944903"}
May 23 22:08:20.072945 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.072916    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8577d958c-dsq25" event={"ID":"b1039fbf-337f-493b-9a32-1cdb43018dca","Type":"ContainerStarted","Data":"a460f6609d51ab702461a759cba7695fa29dfb4b80a7c429855ca7277f901f20"}
May 23 22:08:20.089002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.088981    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:08:20.092320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.092303    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74fd66548c-gxkkj"]
May 23 22:08:20.317178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.317144    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xgj2b\" (UID: \"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:20.319459 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.319439    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41d7b6b6-c0b7-4701-ab1c-9e87787ec57e-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-xgj2b\" (UID: \"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:20.603352 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.603310    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:20.749490 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.749400    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"]
May 23 22:08:20.752014 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:20.751974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d7b6b6_c0b7_4701_ab1c_9e87787ec57e.slice/crio-863626953c6eba2cf88151efb50e2baddb1f65cf8a0be9d3b3327bfc39e7d70e WatchSource:0}: Error finding container 863626953c6eba2cf88151efb50e2baddb1f65cf8a0be9d3b3327bfc39e7d70e: Status 404 returned error can't find the container with id 863626953c6eba2cf88151efb50e2baddb1f65cf8a0be9d3b3327bfc39e7d70e
May 23 22:08:20.876949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.876865    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:08:20.880786 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.880673    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.892315 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.892287    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:08:20.923668 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.923798 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.923798 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.923913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwvfk\" (UniqueName: \"kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.923965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.924014 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.923977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:20.924081 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:20.924012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025304 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025259    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025315    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025358    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025382    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwvfk\" (UniqueName: \"kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025425    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025466    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.025754 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.025498    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.026209 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.026153    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.026337 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.026222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.026561 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.026540    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.026672 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.026643    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.028584 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.028542    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.028705 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.028659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.033581 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.033537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwvfk\" (UniqueName: \"kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk\") pod \"console-6699555b8d-gbgvr\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") " pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.078839 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.078794    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b" event={"ID":"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e","Type":"ContainerStarted","Data":"863626953c6eba2cf88151efb50e2baddb1f65cf8a0be9d3b3327bfc39e7d70e"}
May 23 22:08:21.193499 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.193426    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 23 22:08:21.193654 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.193567    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:21.198679 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.198653    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.201317 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201289    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 23 22:08:21.201433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201322    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 23 22:08:21.201433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201329    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 23 22:08:21.201433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201384    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 23 22:08:21.201433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201405    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 23 22:08:21.201433 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201330    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 23 22:08:21.201692 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201537    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 23 22:08:21.201692 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201605    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d8a4vrmg22a05\""
May 23 22:08:21.201790 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201693    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cg8gn\""
May 23 22:08:21.201932 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201917    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 23 22:08:21.202011 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.201953    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 23 22:08:21.202312 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.202294    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 23 22:08:21.202488 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.202432    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 23 22:08:21.204004 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.203978    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 23 22:08:21.209955 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.209935    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 23 22:08:21.227144 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227369 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227369 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227369 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227369 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227369 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.227631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57q8x\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-kube-api-access-57q8x\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.228425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.228425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.228425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.228425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.227772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329162 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329128    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329174    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329225    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329266    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329291    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329314    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329344    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329367    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329405    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329431    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57q8x\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-kube-api-access-57q8x\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329461    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329495    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329531    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.329598 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.330011 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329610    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.330011 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329642    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.330011 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329671    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.330011 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.329699    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.333363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.330571    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.333363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.331029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.333363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.331240    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.333363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.332588    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.333363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.333199    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.335615 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.335591    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.335751 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.335728    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.335848 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.335828    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336191 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.336015    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336191 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.336132    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336333 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.336291    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-config\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.336510    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.336597    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336830 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.333274    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.336931 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.333285    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.337930 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.337901    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.338636 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.338610    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.342707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.342673    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57q8x\" (UniqueName: \"kubernetes.io/projected/e2ccf8b7-7585-420c-881d-2b9eaa2fce69-kube-api-access-57q8x\") pod \"prometheus-k8s-0\" (UID: \"e2ccf8b7-7585-420c-881d-2b9eaa2fce69\") " pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.475730 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.475650    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0eb6602-11dc-4763-975f-279881acc273" path="/var/lib/kubelet/pods/d0eb6602-11dc-4763-975f-279881acc273/volumes"
May 23 22:08:21.510841 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.510807    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:21.818633 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.818608    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:08:21.821728 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:21.821699    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030b8fdc_697d_4cfe_94a6_5c65f2883dff.slice/crio-eb472bd32d8683fc5d76941046ff7de6cee5c7d198f3e86d1dbfdbdc82596e47 WatchSource:0}: Error finding container eb472bd32d8683fc5d76941046ff7de6cee5c7d198f3e86d1dbfdbdc82596e47: Status 404 returned error can't find the container with id eb472bd32d8683fc5d76941046ff7de6cee5c7d198f3e86d1dbfdbdc82596e47
May 23 22:08:21.842576 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:21.842546    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 23 22:08:21.847635 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:08:21.847597    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ccf8b7_7585_420c_881d_2b9eaa2fce69.slice/crio-b99173e432bbcdf47cc8e408970561da2242404389c3fbdc789c3ad8686af2a9 WatchSource:0}: Error finding container b99173e432bbcdf47cc8e408970561da2242404389c3fbdc789c3ad8686af2a9: Status 404 returned error can't find the container with id b99173e432bbcdf47cc8e408970561da2242404389c3fbdc789c3ad8686af2a9
May 23 22:08:22.084212 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.084178    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699555b8d-gbgvr" event={"ID":"030b8fdc-697d-4cfe-94a6-5c65f2883dff","Type":"ContainerStarted","Data":"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"}
May 23 22:08:22.084553 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.084225    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699555b8d-gbgvr" event={"ID":"030b8fdc-697d-4cfe-94a6-5c65f2883dff","Type":"ContainerStarted","Data":"eb472bd32d8683fc5d76941046ff7de6cee5c7d198f3e86d1dbfdbdc82596e47"}
May 23 22:08:22.088665 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.088569    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"b105a9838456d197ef6c06502dc20ce733934575329ba9f3840b56601ab3359e"}
May 23 22:08:22.088665 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.088603    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"d2d64294f58f73c48726165b8a82c61363f353584c91ef2b90d47e0015076f3e"}
May 23 22:08:22.088665 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.088617    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"6bb6e5aac55df583c02902cae44ff4a82b0f965b642a0a147e4bb8dec76cb566"}
May 23 22:08:22.088665 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.088631    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"75b0cd0f2e45d8e362897a8ced94bdfcfa21b9b767610d487d3ed73e6ec915b8"}
May 23 22:08:22.088665 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.088643    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"00c1b9b37d01552c2e0cb0ff5ca67b721a8745e78aabfa82da8ecaf63b194c5d"}
May 23 22:08:22.091008 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.090975    2575 generic.go:358] "Generic (PLEG): container finished" podID="e2ccf8b7-7585-420c-881d-2b9eaa2fce69" containerID="04796d61435e21f04a355922caf9f126c9b56cfde3ea8a894c45c6c1190d14c3" exitCode=0
May 23 22:08:22.091120 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.091011    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerDied","Data":"04796d61435e21f04a355922caf9f126c9b56cfde3ea8a894c45c6c1190d14c3"}
May 23 22:08:22.091120 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.091042    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"b99173e432bbcdf47cc8e408970561da2242404389c3fbdc789c3ad8686af2a9"}
May 23 22:08:22.093018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.092984    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8577d958c-dsq25" event={"ID":"b1039fbf-337f-493b-9a32-1cdb43018dca","Type":"ContainerStarted","Data":"451e1f8b80916397fc039fb901a73646612d5b9af2912a0f26e55418d0ce6138"}
May 23 22:08:22.102918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.102880    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6699555b8d-gbgvr" podStartSLOduration=2.102868128 podStartE2EDuration="2.102868128s" podCreationTimestamp="2026-05-23 22:08:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:08:22.100541765 +0000 UTC m=+189.221131963" watchObservedRunningTime="2026-05-23 22:08:22.102868128 +0000 UTC m=+189.223458320"
May 23 22:08:22.141488 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:22.141439    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8577d958c-dsq25" podStartSLOduration=1.165025622 podStartE2EDuration="3.141422893s" podCreationTimestamp="2026-05-23 22:08:19 +0000 UTC" firstStartedPulling="2026-05-23 22:08:19.686531235 +0000 UTC m=+186.807121408" lastFinishedPulling="2026-05-23 22:08:21.662928509 +0000 UTC m=+188.783518679" observedRunningTime="2026-05-23 22:08:22.141307993 +0000 UTC m=+189.261898198" watchObservedRunningTime="2026-05-23 22:08:22.141422893 +0000 UTC m=+189.262013103"
May 23 22:08:23.099147 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.099106    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b" event={"ID":"41d7b6b6-c0b7-4701-ab1c-9e87787ec57e","Type":"ContainerStarted","Data":"6b7216e63421579ed531d66fe113b3d758402647d09b6da2b5dc672ec198b437"}
May 23 22:08:23.099601 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.099306    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:23.102642 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.102605    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c73d02a-eed8-4e38-956a-302dd67b6326","Type":"ContainerStarted","Data":"c66c1f9632f5c427f42f9cf1107ef15cfbad9ba442ebe9e2f43dd648e2d3c59e"}
May 23 22:08:23.104870 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.104845    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b"
May 23 22:08:23.115099 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.114946    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-xgj2b" podStartSLOduration=2.271160366 podStartE2EDuration="4.114931241s" podCreationTimestamp="2026-05-23 22:08:19 +0000 UTC" firstStartedPulling="2026-05-23 22:08:20.754225023 +0000 UTC m=+187.874815200" lastFinishedPulling="2026-05-23 22:08:22.597995891 +0000 UTC m=+189.718586075" observedRunningTime="2026-05-23 22:08:23.114658911 +0000 UTC m=+190.235249104" watchObservedRunningTime="2026-05-23 22:08:23.114931241 +0000 UTC m=+190.235521436"
May 23 22:08:23.159258 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:23.159151    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.26074367 podStartE2EDuration="7.159138317s" podCreationTimestamp="2026-05-23 22:08:16 +0000 UTC" firstStartedPulling="2026-05-23 22:08:18.003364854 +0000 UTC m=+185.123955024" lastFinishedPulling="2026-05-23 22:08:22.901759487 +0000 UTC m=+190.022349671" observedRunningTime="2026-05-23 22:08:23.157522825 +0000 UTC m=+190.278113045" watchObservedRunningTime="2026-05-23 22:08:23.159138317 +0000 UTC m=+190.279728506"
May 23 22:08:25.118487 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:25.118448    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"6abaa6ac912650a980489cc584b34dc923e9b0cd043e0c861973ef2b25124766"}
May 23 22:08:25.118487 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:25.118493    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"5ca3977fd07d7c4c63e28f1f157541a4c8d6bc5df00a46636605224e4e83922a"}
May 23 22:08:27.125922 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:27.125883    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"579a90186b45279bec0fa500b32902652f071b8661935b0e294caa34a1b0204a"}
May 23 22:08:27.125922 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:27.125920    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"0907c336b7592dc8b5f74bcb324911362f2230782924f38500c4eb98f07e0503"}
May 23 22:08:27.125922 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:27.125930    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"30b2418aa90dbbc08d44148b1a26f7f1254e8467b6d717ce2b30f3d1543831a8"}
May 23 22:08:27.126476 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:27.125938    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ccf8b7-7585-420c-881d-2b9eaa2fce69","Type":"ContainerStarted","Data":"6dcd5e978d37c0ba5b8d3d02f4a8076eb2d93077ffa35f86833a2581896e06c8"}
May 23 22:08:27.154556 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:27.154509    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.65576236 podStartE2EDuration="6.154491788s" podCreationTimestamp="2026-05-23 22:08:21 +0000 UTC" firstStartedPulling="2026-05-23 22:08:22.092281809 +0000 UTC m=+189.212871994" lastFinishedPulling="2026-05-23 22:08:26.591011252 +0000 UTC m=+193.711601422" observedRunningTime="2026-05-23 22:08:27.152177116 +0000 UTC m=+194.272767356" watchObservedRunningTime="2026-05-23 22:08:27.154491788 +0000 UTC m=+194.275081980"
May 23 22:08:31.193949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:31.193917    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:31.193949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:31.193954    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:31.198585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:31.198561    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:31.511851 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:31.511773    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:08:32.143009 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:32.142983    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:08:32.190735 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:32.190703    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:39.549026 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:39.548996    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:39.549026 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:39.549028    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:57.214186 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.214127    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d5b5db7f6-qmsth" podUID="2ac015aa-68d0-4b44-9654-890e2cd74c28" containerName="console" containerID="cri-o://ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46" gracePeriod=15
May 23 22:08:57.456290 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.456268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d5b5db7f6-qmsth_2ac015aa-68d0-4b44-9654-890e2cd74c28/console/0.log"
May 23 22:08:57.456404 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.456326    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:57.541474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541394    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541440    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541468    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541544    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541592    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcpnz\" (UniqueName: \"kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541617    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541663    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle\") pod \"2ac015aa-68d0-4b44-9654-890e2cd74c28\" (UID: \"2ac015aa-68d0-4b44-9654-890e2cd74c28\") "
May 23 22:08:57.541927 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541770    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:57.541983 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541965    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:57.542037 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.541972    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-service-ca\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.542190 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.542013    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config" (OuterVolumeSpecName: "console-config") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:57.542250 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.542233    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:08:57.543774 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.543750    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:08:57.543858 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.543792    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:08:57.543907 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.543844    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz" (OuterVolumeSpecName: "kube-api-access-jcpnz") pod "2ac015aa-68d0-4b44-9654-890e2cd74c28" (UID: "2ac015aa-68d0-4b44-9654-890e2cd74c28"). InnerVolumeSpecName "kube-api-access-jcpnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:08:57.643350 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643311    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-serving-cert\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.643350 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643342    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-oauth-config\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.643350 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643357    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-oauth-serving-cert\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.643565 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643371    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcpnz\" (UniqueName: \"kubernetes.io/projected/2ac015aa-68d0-4b44-9654-890e2cd74c28-kube-api-access-jcpnz\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.643565 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643385    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-console-config\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:57.643565 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:57.643397    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac015aa-68d0-4b44-9654-890e2cd74c28-trusted-ca-bundle\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:08:58.210062 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210032    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d5b5db7f6-qmsth_2ac015aa-68d0-4b44-9654-890e2cd74c28/console/0.log"
May 23 22:08:58.210246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210089    2575 generic.go:358] "Generic (PLEG): container finished" podID="2ac015aa-68d0-4b44-9654-890e2cd74c28" containerID="ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46" exitCode=2
May 23 22:08:58.210246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210154    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d5b5db7f6-qmsth"
May 23 22:08:58.210246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210166    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5b5db7f6-qmsth" event={"ID":"2ac015aa-68d0-4b44-9654-890e2cd74c28","Type":"ContainerDied","Data":"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"}
May 23 22:08:58.210246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210202    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d5b5db7f6-qmsth" event={"ID":"2ac015aa-68d0-4b44-9654-890e2cd74c28","Type":"ContainerDied","Data":"6eaa5d660846bda2b9bfe0702b770506019a6aed1f37232d54ca1b0ac79b6449"}
May 23 22:08:58.210246 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.210221    2575 scope.go:117] "RemoveContainer" containerID="ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"
May 23 22:08:58.218673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.218507    2575 scope.go:117] "RemoveContainer" containerID="ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"
May 23 22:08:58.218899 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:08:58.218724    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46\": container with ID starting with ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46 not found: ID does not exist" containerID="ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"
May 23 22:08:58.218899 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.218754    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46"} err="failed to get container status \"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46\": rpc error: code = NotFound desc = could not find container \"ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46\": container with ID starting with ec9717697a2fdfcd3294a7dc20ea5f1b351ff14c2136450aa4348ec17543ca46 not found: ID does not exist"
May 23 22:08:58.229967 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.229945    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:58.233473 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:58.233455    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d5b5db7f6-qmsth"]
May 23 22:08:59.474857 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:59.474823    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac015aa-68d0-4b44-9654-890e2cd74c28" path="/var/lib/kubelet/pods/2ac015aa-68d0-4b44-9654-890e2cd74c28/volumes"
May 23 22:08:59.554282 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:59.554258    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:08:59.557965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:08:59.557940    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8577d958c-dsq25"
May 23 22:09:21.511329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:21.511296    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:09:21.526744 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:21.526719    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:09:22.295072 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:22.295031    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 23 22:09:24.267557 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:24.267524    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:09:24.269804 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:24.269775    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8-metrics-certs\") pod \"network-metrics-daemon-d9hx9\" (UID: \"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8\") " pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:09:24.275334 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:24.275313    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h5srv\""
May 23 22:09:24.283063 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:24.283037    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9hx9"
May 23 22:09:24.422479 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:24.422454    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d9hx9"]
May 23 22:09:24.424695 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:09:24.424666    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff2d8ee_7af5_4d42_9a60_f38fdaa305f8.slice/crio-3f2d81c513b6730d36c57de39208f8eb2542216753de6d8d9de95818e1028399 WatchSource:0}: Error finding container 3f2d81c513b6730d36c57de39208f8eb2542216753de6d8d9de95818e1028399: Status 404 returned error can't find the container with id 3f2d81c513b6730d36c57de39208f8eb2542216753de6d8d9de95818e1028399
May 23 22:09:25.288953 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:25.288875    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9hx9" event={"ID":"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8","Type":"ContainerStarted","Data":"3f2d81c513b6730d36c57de39208f8eb2542216753de6d8d9de95818e1028399"}
May 23 22:09:26.293138 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:26.293104    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9hx9" event={"ID":"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8","Type":"ContainerStarted","Data":"ea83f38a9db1a1b1db0193e997133885b9795f77164c82daa86db6a73339e55e"}
May 23 22:09:26.293138 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:26.293140    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9hx9" event={"ID":"8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8","Type":"ContainerStarted","Data":"c46e1980ad788b564b24687bea47e50b2d5ea0be9d14e602f5db7ee5b86ac4ab"}
May 23 22:09:26.310685 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:26.310641    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d9hx9" podStartSLOduration=252.424639272 podStartE2EDuration="4m13.310628261s" podCreationTimestamp="2026-05-23 22:05:13 +0000 UTC" firstStartedPulling="2026-05-23 22:09:24.426271544 +0000 UTC m=+251.546861714" lastFinishedPulling="2026-05-23 22:09:25.312260533 +0000 UTC m=+252.432850703" observedRunningTime="2026-05-23 22:09:26.308399257 +0000 UTC m=+253.428989448" watchObservedRunningTime="2026-05-23 22:09:26.310628261 +0000 UTC m=+253.431218452"
May 23 22:09:39.269916 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.269878    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"]
May 23 22:09:39.270521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.270351    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac015aa-68d0-4b44-9654-890e2cd74c28" containerName="console"
May 23 22:09:39.270521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.270370    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac015aa-68d0-4b44-9654-890e2cd74c28" containerName="console"
May 23 22:09:39.270521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.270447    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ac015aa-68d0-4b44-9654-890e2cd74c28" containerName="console"
May 23 22:09:39.273833 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.273725    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.276130 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276109    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 23 22:09:39.276285 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276155    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 23 22:09:39.276285 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276206    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 23 22:09:39.276442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276294    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 23 22:09:39.276442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276371    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wmkgv\""
May 23 22:09:39.276626 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.276611    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 23 22:09:39.281137 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.281115    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 23 22:09:39.283984 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.283961    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"]
May 23 22:09:39.390181 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8n6l\" (UniqueName: \"kubernetes.io/projected/76d30517-3d41-4b35-b0d9-2f9f763fc34d-kube-api-access-f8n6l\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-metrics-client-ca\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-federate-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.390425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.390413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-serving-certs-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491209 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491179    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491353 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491216    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491353 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491239    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-federate-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491460 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491422    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-serving-certs-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491520 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491474    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491520 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491505    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8n6l\" (UniqueName: \"kubernetes.io/projected/76d30517-3d41-4b35-b0d9-2f9f763fc34d-kube-api-access-f8n6l\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491538    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-metrics-client-ca\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.491827 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.491791    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.492280 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.492249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-serving-certs-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.492406 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.492253    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-metrics-client-ca\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.492695 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.492675    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.493882 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.493861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.493991 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.493908    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-federate-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.494190 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.494167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-secret-telemeter-client\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.494336 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.494321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76d30517-3d41-4b35-b0d9-2f9f763fc34d-telemeter-client-tls\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.500383 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.500363    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8n6l\" (UniqueName: \"kubernetes.io/projected/76d30517-3d41-4b35-b0d9-2f9f763fc34d-kube-api-access-f8n6l\") pod \"telemeter-client-7f647f76c6-bs5zr\" (UID: \"76d30517-3d41-4b35-b0d9-2f9f763fc34d\") " pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.584619 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.584565    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"
May 23 22:09:39.712899 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:39.712866    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f647f76c6-bs5zr"]
May 23 22:09:39.714913 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:09:39.714889    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d30517_3d41_4b35_b0d9_2f9f763fc34d.slice/crio-29c6fd22155cb2450e565ae11c91a4e2ff270fa8565e8ae161eece20fd03b50a WatchSource:0}: Error finding container 29c6fd22155cb2450e565ae11c91a4e2ff270fa8565e8ae161eece20fd03b50a: Status 404 returned error can't find the container with id 29c6fd22155cb2450e565ae11c91a4e2ff270fa8565e8ae161eece20fd03b50a
May 23 22:09:40.334442 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:40.334407    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr" event={"ID":"76d30517-3d41-4b35-b0d9-2f9f763fc34d","Type":"ContainerStarted","Data":"29c6fd22155cb2450e565ae11c91a4e2ff270fa8565e8ae161eece20fd03b50a"}
May 23 22:09:42.345799 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:42.345759    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr" event={"ID":"76d30517-3d41-4b35-b0d9-2f9f763fc34d","Type":"ContainerStarted","Data":"2f224881a35659b6c27ef0d5287a222d060ee981178bcc181baf531355832e29"}
May 23 22:09:42.345799 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:42.345803    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr" event={"ID":"76d30517-3d41-4b35-b0d9-2f9f763fc34d","Type":"ContainerStarted","Data":"b6c3e15536a9a9641b2c29d89bd793afcaeb1ada21b816b005a8b56cdebd08d7"}
May 23 22:09:42.346273 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:42.345816    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr" event={"ID":"76d30517-3d41-4b35-b0d9-2f9f763fc34d","Type":"ContainerStarted","Data":"997055a1d017211cd33a15d6a07d1d97214ae060a04f786e5189436971ccd723"}
May 23 22:09:42.368718 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:09:42.368659    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f647f76c6-bs5zr" podStartSLOduration=1.449339635 podStartE2EDuration="3.368635972s" podCreationTimestamp="2026-05-23 22:09:39 +0000 UTC" firstStartedPulling="2026-05-23 22:09:39.717205792 +0000 UTC m=+266.837795962" lastFinishedPulling="2026-05-23 22:09:41.63650213 +0000 UTC m=+268.757092299" observedRunningTime="2026-05-23 22:09:42.366719961 +0000 UTC m=+269.487310154" watchObservedRunningTime="2026-05-23 22:09:42.368635972 +0000 UTC m=+269.489226167"
May 23 22:10:01.971341 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:01.971305    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:10:13.388225 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:13.388189    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:10:13.389501 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:13.389479    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:10:13.395708 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:13.395687    2575 kubelet.go:1628] "Image garbage collection succeeded"
May 23 22:10:27.422318 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.422260    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6699555b8d-gbgvr" podUID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" containerName="console" containerID="cri-o://ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576" gracePeriod=15
May 23 22:10:27.667946 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.667924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6699555b8d-gbgvr_030b8fdc-697d-4cfe-94a6-5c65f2883dff/console/0.log"
May 23 22:10:27.668064 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.667983    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:10:27.759642 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759563    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759642 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759596    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759642 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759615    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759912 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759657    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwvfk\" (UniqueName: \"kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759912 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759764    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759912 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759797    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.759912 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.759832    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle\") pod \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\" (UID: \"030b8fdc-697d-4cfe-94a6-5c65f2883dff\") "
May 23 22:10:27.760185 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760037    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:10:27.760185 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760135    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca" (OuterVolumeSpecName: "service-ca") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:10:27.760361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760260    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config" (OuterVolumeSpecName: "console-config") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:10:27.760361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760275    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 23 22:10:27.760361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760272    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-oauth-serving-cert\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.760361 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.760313    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-service-ca\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.761829 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.761809    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:10:27.762018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.762000    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:10:27.762018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.762011    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk" (OuterVolumeSpecName: "kube-api-access-wwvfk") pod "030b8fdc-697d-4cfe-94a6-5c65f2883dff" (UID: "030b8fdc-697d-4cfe-94a6-5c65f2883dff"). InnerVolumeSpecName "kube-api-access-wwvfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:10:27.860950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.860923    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-serving-cert\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.860950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.860947    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-trusted-ca-bundle\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.860950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.860957    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-oauth-config\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.861160 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.860966    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwvfk\" (UniqueName: \"kubernetes.io/projected/030b8fdc-697d-4cfe-94a6-5c65f2883dff-kube-api-access-wwvfk\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:27.861160 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:27.860976    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/030b8fdc-697d-4cfe-94a6-5c65f2883dff-console-config\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:10:28.485585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485556    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6699555b8d-gbgvr_030b8fdc-697d-4cfe-94a6-5c65f2883dff/console/0.log"
May 23 22:10:28.485997 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485599    2575 generic.go:358] "Generic (PLEG): container finished" podID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" containerID="ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576" exitCode=2
May 23 22:10:28.485997 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485634    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699555b8d-gbgvr" event={"ID":"030b8fdc-697d-4cfe-94a6-5c65f2883dff","Type":"ContainerDied","Data":"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"}
May 23 22:10:28.485997 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485664    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6699555b8d-gbgvr"
May 23 22:10:28.485997 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485675    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6699555b8d-gbgvr" event={"ID":"030b8fdc-697d-4cfe-94a6-5c65f2883dff","Type":"ContainerDied","Data":"eb472bd32d8683fc5d76941046ff7de6cee5c7d198f3e86d1dbfdbdc82596e47"}
May 23 22:10:28.485997 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.485688    2575 scope.go:117] "RemoveContainer" containerID="ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"
May 23 22:10:28.493512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.493494    2575 scope.go:117] "RemoveContainer" containerID="ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"
May 23 22:10:28.493849 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:10:28.493829    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576\": container with ID starting with ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576 not found: ID does not exist" containerID="ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"
May 23 22:10:28.493903 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.493858    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576"} err="failed to get container status \"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576\": rpc error: code = NotFound desc = could not find container \"ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576\": container with ID starting with ba381c257948fb8f6733aa4bc1363f0261e10fceadca512c80f5dda26ef58576 not found: ID does not exist"
May 23 22:10:28.506738 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.506716    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:10:28.511888 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.511868    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6699555b8d-gbgvr"]
May 23 22:10:28.709790 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.709755    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rmvmn"]
May 23 22:10:28.710143 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.710126    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" containerName="console"
May 23 22:10:28.710222 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.710144    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" containerName="console"
May 23 22:10:28.710281 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.710231    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" containerName="console"
May 23 22:10:28.714425 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.714404    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.716796 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.716770    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 23 22:10:28.720785 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.720761    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmvmn"]
May 23 22:10:28.767964 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.767907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-kubelet-config\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.767964 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.767938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45797fbd-cd55-4a94-a8d5-f2ec2812f644-original-pull-secret\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.767964 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.767959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-dbus\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.868546 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.868520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-kubelet-config\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.868638 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.868552    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45797fbd-cd55-4a94-a8d5-f2ec2812f644-original-pull-secret\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.868638 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.868574    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-dbus\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.868719 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.868646    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-kubelet-config\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.868752 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.868718    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/45797fbd-cd55-4a94-a8d5-f2ec2812f644-dbus\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:28.870894 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:28.870873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/45797fbd-cd55-4a94-a8d5-f2ec2812f644-original-pull-secret\") pod \"global-pull-secret-syncer-rmvmn\" (UID: \"45797fbd-cd55-4a94-a8d5-f2ec2812f644\") " pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:29.024306 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:29.024225    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rmvmn"
May 23 22:10:29.145212 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:29.145157    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rmvmn"]
May 23 22:10:29.147319 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:10:29.147293    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45797fbd_cd55_4a94_a8d5_f2ec2812f644.slice/crio-c4c0f3d80968c26bc401217400feca643c3a385f0fb47280942e198429c57bc1 WatchSource:0}: Error finding container c4c0f3d80968c26bc401217400feca643c3a385f0fb47280942e198429c57bc1: Status 404 returned error can't find the container with id c4c0f3d80968c26bc401217400feca643c3a385f0fb47280942e198429c57bc1
May 23 22:10:29.148913 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:29.148896    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 23 22:10:29.475102 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:29.475074    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="030b8fdc-697d-4cfe-94a6-5c65f2883dff" path="/var/lib/kubelet/pods/030b8fdc-697d-4cfe-94a6-5c65f2883dff/volumes"
May 23 22:10:29.490255 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:29.490228    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmvmn" event={"ID":"45797fbd-cd55-4a94-a8d5-f2ec2812f644","Type":"ContainerStarted","Data":"c4c0f3d80968c26bc401217400feca643c3a385f0fb47280942e198429c57bc1"}
May 23 22:10:33.503377 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:33.503342    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rmvmn" event={"ID":"45797fbd-cd55-4a94-a8d5-f2ec2812f644","Type":"ContainerStarted","Data":"b4e9d028f653756da21081858e04205c9ed6ce81f2dead2bca5ee189b7b9393f"}
May 23 22:10:33.518824 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:10:33.518777    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rmvmn" podStartSLOduration=1.298796958 podStartE2EDuration="5.518765017s" podCreationTimestamp="2026-05-23 22:10:28 +0000 UTC" firstStartedPulling="2026-05-23 22:10:29.149027261 +0000 UTC m=+316.269617430" lastFinishedPulling="2026-05-23 22:10:33.368995314 +0000 UTC m=+320.489585489" observedRunningTime="2026-05-23 22:10:33.517259311 +0000 UTC m=+320.637849528" watchObservedRunningTime="2026-05-23 22:10:33.518765017 +0000 UTC m=+320.639355208"
May 23 22:12:15.311374 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.311339    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"]
May 23 22:12:15.314770 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.314747    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.318119 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.318099    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 23 22:12:15.318241 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.318101    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 23 22:12:15.318241 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.318101    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mkb7m\""
May 23 22:12:15.318413 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.318399    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 23 22:12:15.318512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.318496    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 23 22:12:15.329329 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.329300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdgg\" (UniqueName: \"kubernetes.io/projected/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-kube-api-access-pwdgg\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.329445 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.329368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.329445 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.329397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.331761 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.331739    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"]
May 23 22:12:15.430443 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.430418    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.430563 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.430449    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.430563 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.430514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdgg\" (UniqueName: \"kubernetes.io/projected/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-kube-api-access-pwdgg\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.432949 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.432921    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.433090 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.432949    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.439763 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.439741    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdgg\" (UniqueName: \"kubernetes.io/projected/bec686f0-5b57-4fa3-80a7-bf02d81fa2ac-kube-api-access-pwdgg\") pod \"opendatahub-operator-controller-manager-696794d4d9-swdqj\" (UID: \"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac\") " pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.625188 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.625148    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:15.762587 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.762565    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"]
May 23 22:12:15.764498 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:12:15.764471    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec686f0_5b57_4fa3_80a7_bf02d81fa2ac.slice/crio-be2b47c70b09ced8cd358f3b66b7940a4c3d90066fcbdd08cefbea4d33a05a37 WatchSource:0}: Error finding container be2b47c70b09ced8cd358f3b66b7940a4c3d90066fcbdd08cefbea4d33a05a37: Status 404 returned error can't find the container with id be2b47c70b09ced8cd358f3b66b7940a4c3d90066fcbdd08cefbea4d33a05a37
May 23 22:12:15.794089 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:15.794059    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj" event={"ID":"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac","Type":"ContainerStarted","Data":"be2b47c70b09ced8cd358f3b66b7940a4c3d90066fcbdd08cefbea4d33a05a37"}
May 23 22:12:18.808399 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.808366    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"]
May 23 22:12:18.815493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.815462    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:18.815631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.815494    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj" event={"ID":"bec686f0-5b57-4fa3-80a7-bf02d81fa2ac","Type":"ContainerStarted","Data":"6109ee0234c7adad7487f2cfd7922b0283fba794055df73038406857918f0d32"}
May 23 22:12:18.815631 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.815611    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.818813 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.818789    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 23 22:12:18.819009 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.818970    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 23 22:12:18.819009 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.818979    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 23 22:12:18.819251 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.819133    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 23 22:12:18.819251 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.819184    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5jpj8\""
May 23 22:12:18.819489 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.819473    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 23 22:12:18.820362 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.820339    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"]
May 23 22:12:18.843536 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.843500    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj" podStartSLOduration=1.40241436 podStartE2EDuration="3.84348963s" podCreationTimestamp="2026-05-23 22:12:15 +0000 UTC" firstStartedPulling="2026-05-23 22:12:15.76619192 +0000 UTC m=+422.886782090" lastFinishedPulling="2026-05-23 22:12:18.207267176 +0000 UTC m=+425.327857360" observedRunningTime="2026-05-23 22:12:18.842979986 +0000 UTC m=+425.963570190" watchObservedRunningTime="2026-05-23 22:12:18.84348963 +0000 UTC m=+425.964079822"
May 23 22:12:18.861542 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.861516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.861655 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.861552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9rwz\" (UniqueName: \"kubernetes.io/projected/cfa77285-f959-48e7-b6dd-e643cc714edb-kube-api-access-k9rwz\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.861655 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.861635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfa77285-f959-48e7-b6dd-e643cc714edb-manager-config\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.861762 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.861676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-metrics-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.962181 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.962150    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.962320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.962189    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9rwz\" (UniqueName: \"kubernetes.io/projected/cfa77285-f959-48e7-b6dd-e643cc714edb-kube-api-access-k9rwz\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.962320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.962235    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfa77285-f959-48e7-b6dd-e643cc714edb-manager-config\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.962320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.962262    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-metrics-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.962900 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.962881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfa77285-f959-48e7-b6dd-e643cc714edb-manager-config\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.964569 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.964548    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-metrics-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.964642 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.964589    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfa77285-f959-48e7-b6dd-e643cc714edb-cert\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:18.972257 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:18.972239    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9rwz\" (UniqueName: \"kubernetes.io/projected/cfa77285-f959-48e7-b6dd-e643cc714edb-kube-api-access-k9rwz\") pod \"lws-controller-manager-6bf4fb87f5-w5rwk\" (UID: \"cfa77285-f959-48e7-b6dd-e643cc714edb\") " pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:19.126224 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:19.126203    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:19.252955 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:19.252928    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"]
May 23 22:12:19.255285 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:12:19.255257    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa77285_f959_48e7_b6dd_e643cc714edb.slice/crio-04d466ca0374daf0b84786bec30ddbe4a1f683c1d73d716952e0ab2c6922ff0d WatchSource:0}: Error finding container 04d466ca0374daf0b84786bec30ddbe4a1f683c1d73d716952e0ab2c6922ff0d: Status 404 returned error can't find the container with id 04d466ca0374daf0b84786bec30ddbe4a1f683c1d73d716952e0ab2c6922ff0d
May 23 22:12:19.814218 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:19.814183    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk" event={"ID":"cfa77285-f959-48e7-b6dd-e643cc714edb","Type":"ContainerStarted","Data":"04d466ca0374daf0b84786bec30ddbe4a1f683c1d73d716952e0ab2c6922ff0d"}
May 23 22:12:22.825107 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:22.825005    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk" event={"ID":"cfa77285-f959-48e7-b6dd-e643cc714edb","Type":"ContainerStarted","Data":"c3ccce531756fa474626e70ac0fa7c21635477267c42e8f454da132c485fdb77"}
May 23 22:12:22.825107 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:22.825069    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:22.841811 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:22.841763    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk" podStartSLOduration=1.691242232 podStartE2EDuration="4.841749562s" podCreationTimestamp="2026-05-23 22:12:18 +0000 UTC" firstStartedPulling="2026-05-23 22:12:19.257203779 +0000 UTC m=+426.377793949" lastFinishedPulling="2026-05-23 22:12:22.407711102 +0000 UTC m=+429.528301279" observedRunningTime="2026-05-23 22:12:22.839967379 +0000 UTC m=+429.960557572" watchObservedRunningTime="2026-05-23 22:12:22.841749562 +0000 UTC m=+429.962339754"
May 23 22:12:29.817030 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:29.817001    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696794d4d9-swdqj"
May 23 22:12:33.685349 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.685316    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"]
May 23 22:12:33.688620 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.688598    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.692190 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.692166    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 23 22:12:33.692190 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.692183    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rhbsg\""
May 23 22:12:33.692345 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.692236    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 23 22:12:33.696953 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.696930    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"]
May 23 22:12:33.788372 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.788344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe26eec-33b9-415f-8ecb-4819d016271d-tmp\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.788531 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.788387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe26eec-33b9-415f-8ecb-4819d016271d-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.788531 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.788460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vntq\" (UniqueName: \"kubernetes.io/projected/afe26eec-33b9-415f-8ecb-4819d016271d-kube-api-access-7vntq\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.830028 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.830008    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bf4fb87f5-w5rwk"
May 23 22:12:33.889325 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.889295    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe26eec-33b9-415f-8ecb-4819d016271d-tmp\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.889482 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.889360    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe26eec-33b9-415f-8ecb-4819d016271d-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.889657 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.889630    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vntq\" (UniqueName: \"kubernetes.io/projected/afe26eec-33b9-415f-8ecb-4819d016271d-kube-api-access-7vntq\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.891552 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.891529    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afe26eec-33b9-415f-8ecb-4819d016271d-tmp\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.891746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.891730    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe26eec-33b9-415f-8ecb-4819d016271d-tls-certs\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.896977 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.896957    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vntq\" (UniqueName: \"kubernetes.io/projected/afe26eec-33b9-415f-8ecb-4819d016271d-kube-api-access-7vntq\") pod \"kube-auth-proxy-59f475c6cf-zlwkb\" (UID: \"afe26eec-33b9-415f-8ecb-4819d016271d\") " pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:33.999320 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:33.999248    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"
May 23 22:12:34.123152 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:34.123125    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb"]
May 23 22:12:34.125756 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:12:34.125724    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe26eec_33b9_415f_8ecb_4819d016271d.slice/crio-0d3d534bb1eec5c596dd78db4cc10fb3b7235ce17017b705550805799de5b764 WatchSource:0}: Error finding container 0d3d534bb1eec5c596dd78db4cc10fb3b7235ce17017b705550805799de5b764: Status 404 returned error can't find the container with id 0d3d534bb1eec5c596dd78db4cc10fb3b7235ce17017b705550805799de5b764
May 23 22:12:34.863660 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:34.863620    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb" event={"ID":"afe26eec-33b9-415f-8ecb-4819d016271d","Type":"ContainerStarted","Data":"0d3d534bb1eec5c596dd78db4cc10fb3b7235ce17017b705550805799de5b764"}
May 23 22:12:37.875603 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:37.875571    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb" event={"ID":"afe26eec-33b9-415f-8ecb-4819d016271d","Type":"ContainerStarted","Data":"ada33a65d9eee130093053b2f7a2ff54ab5b5c4b0b9e9c20598ff256e5cdc449"}
May 23 22:12:37.894155 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:12:37.894104    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59f475c6cf-zlwkb" podStartSLOduration=1.559366679 podStartE2EDuration="4.8940883s" podCreationTimestamp="2026-05-23 22:12:33 +0000 UTC" firstStartedPulling="2026-05-23 22:12:34.127575939 +0000 UTC m=+441.248166108" lastFinishedPulling="2026-05-23 22:12:37.462297555 +0000 UTC m=+444.582887729" observedRunningTime="2026-05-23 22:12:37.893099619 +0000 UTC m=+445.013689811" watchObservedRunningTime="2026-05-23 22:12:37.8940883 +0000 UTC m=+445.014678492"
May 23 22:14:18.454634 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.454557    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"]
May 23 22:14:18.457691 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.457676    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.460669 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.460646    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 23 22:14:18.460891 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.460876    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 23 22:14:18.461474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.461454    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wvmxv\""
May 23 22:14:18.461474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.461444    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 23 22:14:18.461813 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.461800    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 23 22:14:18.466113 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.466094    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"]
May 23 22:14:18.520613 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.520590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.520714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.520631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed1295aa-3286-44d9-84fc-f35026220af2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.520714 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.520655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdnl2\" (UniqueName: \"kubernetes.io/projected/ed1295aa-3286-44d9-84fc-f35026220af2-kube-api-access-fdnl2\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.621950 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.621918    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdnl2\" (UniqueName: \"kubernetes.io/projected/ed1295aa-3286-44d9-84fc-f35026220af2-kube-api-access-fdnl2\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.622101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.621995    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.622101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.622027    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed1295aa-3286-44d9-84fc-f35026220af2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.622179 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:14:18.622133    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
May 23 22:14:18.622212 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:14:18.622204    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert podName:ed1295aa-3286-44d9-84fc-f35026220af2 nodeName:}" failed. No retries permitted until 2026-05-23 22:14:19.122186312 +0000 UTC m=+546.242776482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-ns9cj" (UID: "ed1295aa-3286-44d9-84fc-f35026220af2") : secret "plugin-serving-cert" not found
May 23 22:14:18.622625 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.622610    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed1295aa-3286-44d9-84fc-f35026220af2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:18.634930 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:18.634900    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdnl2\" (UniqueName: \"kubernetes.io/projected/ed1295aa-3286-44d9-84fc-f35026220af2-kube-api-access-fdnl2\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:19.125839 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:19.125804    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:19.128298 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:19.128276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1295aa-3286-44d9-84fc-f35026220af2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-ns9cj\" (UID: \"ed1295aa-3286-44d9-84fc-f35026220af2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:19.383090 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:19.383002    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"
May 23 22:14:19.507582 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:19.507557    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj"]
May 23 22:14:19.509377 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:14:19.509351    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded1295aa_3286_44d9_84fc_f35026220af2.slice/crio-992b962837eed22db412129019245edcdb23c4a0e4a73281c69488479d91af51 WatchSource:0}: Error finding container 992b962837eed22db412129019245edcdb23c4a0e4a73281c69488479d91af51: Status 404 returned error can't find the container with id 992b962837eed22db412129019245edcdb23c4a0e4a73281c69488479d91af51
May 23 22:14:20.195924 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:20.195891    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj" event={"ID":"ed1295aa-3286-44d9-84fc-f35026220af2","Type":"ContainerStarted","Data":"992b962837eed22db412129019245edcdb23c4a0e4a73281c69488479d91af51"}
May 23 22:14:41.276640 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:41.276599    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj" event={"ID":"ed1295aa-3286-44d9-84fc-f35026220af2","Type":"ContainerStarted","Data":"83c628b16e67153d84ce7ba26a56425dcadcf1da91841e40f00a55821c950b1f"}
May 23 22:14:41.297725 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:14:41.297679    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-ns9cj" podStartSLOduration=1.7389045969999999 podStartE2EDuration="23.297665556s" podCreationTimestamp="2026-05-23 22:14:18 +0000 UTC" firstStartedPulling="2026-05-23 22:14:19.510613198 +0000 UTC m=+546.631203367" lastFinishedPulling="2026-05-23 22:14:41.069374151 +0000 UTC m=+568.189964326" observedRunningTime="2026-05-23 22:14:41.295290255 +0000 UTC m=+568.415880446" watchObservedRunningTime="2026-05-23 22:14:41.297665556 +0000 UTC m=+568.418255789"
May 23 22:15:02.520854 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.520820    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:02.592435 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.592396    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:02.592610 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.592481    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:02.594966 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.594945    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2nnzw\""
May 23 22:15:02.705440 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.705401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75gb\" (UniqueName: \"kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb\") pod \"authorino-f99f4b5cd-7t62q\" (UID: \"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3\") " pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:02.727253 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.727218    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:02.752149 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.752121    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:02.752311 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.752266    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:02.806402 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.806342    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d75gb\" (UniqueName: \"kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb\") pod \"authorino-f99f4b5cd-7t62q\" (UID: \"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3\") " pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:02.814616 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.814587    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75gb\" (UniqueName: \"kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb\") pod \"authorino-f99f4b5cd-7t62q\" (UID: \"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3\") " pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:02.901379 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.901353    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:02.907319 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:02.907293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txs6x\" (UniqueName: \"kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x\") pod \"authorino-7498df8756-r9jjd\" (UID: \"279c2db1-0479-4a5f-ac83-9d16501c3691\") " pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:03.008326 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.008300    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txs6x\" (UniqueName: \"kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x\") pod \"authorino-7498df8756-r9jjd\" (UID: \"279c2db1-0479-4a5f-ac83-9d16501c3691\") " pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:03.017542 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.017518    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txs6x\" (UniqueName: \"kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x\") pod \"authorino-7498df8756-r9jjd\" (UID: \"279c2db1-0479-4a5f-ac83-9d16501c3691\") " pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:03.027101 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.027079    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:03.029405 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:15:03.029383    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a9b67dd_2f2c_4711_b3fe_09e46d7d36d3.slice/crio-a75271fc19bdbd8345d83168ff0195b33544419e3b12652b9be484b5e82c87ed WatchSource:0}: Error finding container a75271fc19bdbd8345d83168ff0195b33544419e3b12652b9be484b5e82c87ed: Status 404 returned error can't find the container with id a75271fc19bdbd8345d83168ff0195b33544419e3b12652b9be484b5e82c87ed
May 23 22:15:03.060765 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.060716    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:03.181881 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.181857    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:03.346340 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.346302    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-r9jjd" event={"ID":"279c2db1-0479-4a5f-ac83-9d16501c3691","Type":"ContainerStarted","Data":"14c0cf0857f62f98e446dc3b021e0ebc93f8bc6e4440e85af3670e5b4b7d5286"}
May 23 22:15:03.347130 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:03.347107    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" event={"ID":"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3","Type":"ContainerStarted","Data":"a75271fc19bdbd8345d83168ff0195b33544419e3b12652b9be484b5e82c87ed"}
May 23 22:15:08.367438 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:08.367394    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-r9jjd" event={"ID":"279c2db1-0479-4a5f-ac83-9d16501c3691","Type":"ContainerStarted","Data":"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"}
May 23 22:15:08.368550 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:08.368528    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" event={"ID":"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3","Type":"ContainerStarted","Data":"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"}
May 23 22:15:08.382255 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:08.382216    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-r9jjd" podStartSLOduration=2.234041957 podStartE2EDuration="6.382203378s" podCreationTimestamp="2026-05-23 22:15:02 +0000 UTC" firstStartedPulling="2026-05-23 22:15:03.187286755 +0000 UTC m=+590.307876940" lastFinishedPulling="2026-05-23 22:15:07.335448186 +0000 UTC m=+594.456038361" observedRunningTime="2026-05-23 22:15:08.380975602 +0000 UTC m=+595.501565794" watchObservedRunningTime="2026-05-23 22:15:08.382203378 +0000 UTC m=+595.502793570"
May 23 22:15:08.395474 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:08.395431    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" podStartSLOduration=2.102167191 podStartE2EDuration="6.395419057s" podCreationTimestamp="2026-05-23 22:15:02 +0000 UTC" firstStartedPulling="2026-05-23 22:15:03.030688051 +0000 UTC m=+590.151278222" lastFinishedPulling="2026-05-23 22:15:07.323939914 +0000 UTC m=+594.444530088" observedRunningTime="2026-05-23 22:15:08.393761743 +0000 UTC m=+595.514351935" watchObservedRunningTime="2026-05-23 22:15:08.395419057 +0000 UTC m=+595.516009248"
May 23 22:15:08.417297 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:08.417264    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:10.376852 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:10.376811    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" podUID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" containerName="authorino" containerID="cri-o://5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d" gracePeriod=30
May 23 22:15:10.616306 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:10.616284    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:10.672216 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:10.672150    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d75gb\" (UniqueName: \"kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb\") pod \"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3\" (UID: \"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3\") "
May 23 22:15:10.674231 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:10.674203    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb" (OuterVolumeSpecName: "kube-api-access-d75gb") pod "6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" (UID: "6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3"). InnerVolumeSpecName "kube-api-access-d75gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:15:10.772667 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:10.772639    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d75gb\" (UniqueName: \"kubernetes.io/projected/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3-kube-api-access-d75gb\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:15:11.382175 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.382141    2575 generic.go:358] "Generic (PLEG): container finished" podID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" containerID="5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d" exitCode=0
May 23 22:15:11.382585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.382182    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" event={"ID":"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3","Type":"ContainerDied","Data":"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"}
May 23 22:15:11.382585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.382198    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7t62q"
May 23 22:15:11.382585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.382223    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7t62q" event={"ID":"6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3","Type":"ContainerDied","Data":"a75271fc19bdbd8345d83168ff0195b33544419e3b12652b9be484b5e82c87ed"}
May 23 22:15:11.382585 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.382239    2575 scope.go:117] "RemoveContainer" containerID="5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"
May 23 22:15:11.390018 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.389998    2575 scope.go:117] "RemoveContainer" containerID="5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"
May 23 22:15:11.390294 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:15:11.390274    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d\": container with ID starting with 5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d not found: ID does not exist" containerID="5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"
May 23 22:15:11.390351 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.390301    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d"} err="failed to get container status \"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d\": rpc error: code = NotFound desc = could not find container \"5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d\": container with ID starting with 5a3aecc86d188be1d5a6655415fa47d6af99e7e49ac8f4ba4e48598f728c534d not found: ID does not exist"
May 23 22:15:11.402998 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.402979    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:11.406857 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.406838    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7t62q"]
May 23 22:15:11.475953 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:11.475925    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" path="/var/lib/kubelet/pods/6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3/volumes"
May 23 22:15:13.414238 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:13.414210    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:15:13.414722 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:13.414704    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:15:30.306167 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.306128    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r6wd5"]
May 23 22:15:30.308588 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.306591    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" containerName="authorino"
May 23 22:15:30.308588 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.306608    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" containerName="authorino"
May 23 22:15:30.308588 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.306676    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a9b67dd-2f2c-4711-b3fe-09e46d7d36d3" containerName="authorino"
May 23 22:15:30.309482 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.309463    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:30.316247 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.315870    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r6wd5"]
May 23 22:15:30.435473 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.435444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgbd7\" (UniqueName: \"kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7\") pod \"authorino-8b475cf9f-r6wd5\" (UID: \"71dfde52-7886-4227-b179-d7d56e9e7968\") " pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:30.526168 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.526135    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r6wd5"]
May 23 22:15:30.526379 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:15:30.526357    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sgbd7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-r6wd5" podUID="71dfde52-7886-4227-b179-d7d56e9e7968"
May 23 22:15:30.536735 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.536711    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgbd7\" (UniqueName: \"kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7\") pod \"authorino-8b475cf9f-r6wd5\" (UID: \"71dfde52-7886-4227-b179-d7d56e9e7968\") " pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:30.557215 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.557152    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7696df7fc5-gffdf"]
May 23 22:15:30.559797 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.559779    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgbd7\" (UniqueName: \"kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7\") pod \"authorino-8b475cf9f-r6wd5\" (UID: \"71dfde52-7886-4227-b179-d7d56e9e7968\") " pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:30.560375 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.560358    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:30.567842 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.567820    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7696df7fc5-gffdf"]
May 23 22:15:30.638061 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.638026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwln7\" (UniqueName: \"kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7\") pod \"authorino-7696df7fc5-gffdf\" (UID: \"ddb6b728-275c-4103-a731-eb72af97c188\") " pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:30.666259 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.666232    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7696df7fc5-gffdf"]
May 23 22:15:30.666449 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:15:30.666430    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lwln7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7696df7fc5-gffdf" podUID="ddb6b728-275c-4103-a731-eb72af97c188"
May 23 22:15:30.693226 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.693201    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:15:30.696467 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.696444    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.698972 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.698951    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 23 22:15:30.705694 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.705671    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:15:30.738689 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.738665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qsd\" (UniqueName: \"kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.738778 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.738713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.738778 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.738757    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwln7\" (UniqueName: \"kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7\") pod \"authorino-7696df7fc5-gffdf\" (UID: \"ddb6b728-275c-4103-a731-eb72af97c188\") " pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:30.746810 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.746789    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwln7\" (UniqueName: \"kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7\") pod \"authorino-7696df7fc5-gffdf\" (UID: \"ddb6b728-275c-4103-a731-eb72af97c188\") " pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:30.839342 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.839268    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.839342 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.839336    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qsd\" (UniqueName: \"kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.841562 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.841535    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:30.847173 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:30.847151    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qsd\" (UniqueName: \"kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd\") pod \"authorino-655f8d94c9-pnkl7\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") " pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:31.006574 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.006542    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:15:31.127513 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.127318    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:15:31.130348 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:15:31.130322    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fb89323_99c4_40e9_9598_c6b20f0212fd.slice/crio-c652f088590e7002005a952d3959f1d3fd36aefc740d42b70087e21f03d20236 WatchSource:0}: Error finding container c652f088590e7002005a952d3959f1d3fd36aefc740d42b70087e21f03d20236: Status 404 returned error can't find the container with id c652f088590e7002005a952d3959f1d3fd36aefc740d42b70087e21f03d20236
May 23 22:15:31.131562 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.131547    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 23 22:15:31.447859 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.447837    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:31.447859 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.447851    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:31.448226 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.447830    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" event={"ID":"1fb89323-99c4-40e9-9598-c6b20f0212fd","Type":"ContainerStarted","Data":"c652f088590e7002005a952d3959f1d3fd36aefc740d42b70087e21f03d20236"}
May 23 22:15:31.452716 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.452700    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:31.456904 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.456888    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:31.544812 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.544780    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgbd7\" (UniqueName: \"kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7\") pod \"71dfde52-7886-4227-b179-d7d56e9e7968\" (UID: \"71dfde52-7886-4227-b179-d7d56e9e7968\") "
May 23 22:15:31.545181 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.544859    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwln7\" (UniqueName: \"kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7\") pod \"ddb6b728-275c-4103-a731-eb72af97c188\" (UID: \"ddb6b728-275c-4103-a731-eb72af97c188\") "
May 23 22:15:31.551493 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.551405    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7" (OuterVolumeSpecName: "kube-api-access-sgbd7") pod "71dfde52-7886-4227-b179-d7d56e9e7968" (UID: "71dfde52-7886-4227-b179-d7d56e9e7968"). InnerVolumeSpecName "kube-api-access-sgbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:15:31.552112 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.552086    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7" (OuterVolumeSpecName: "kube-api-access-lwln7") pod "ddb6b728-275c-4103-a731-eb72af97c188" (UID: "ddb6b728-275c-4103-a731-eb72af97c188"). InnerVolumeSpecName "kube-api-access-lwln7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:15:31.646545 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.646510    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgbd7\" (UniqueName: \"kubernetes.io/projected/71dfde52-7886-4227-b179-d7d56e9e7968-kube-api-access-sgbd7\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:15:31.646545 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:31.646534    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwln7\" (UniqueName: \"kubernetes.io/projected/ddb6b728-275c-4103-a731-eb72af97c188-kube-api-access-lwln7\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:15:32.451961 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.451933    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7696df7fc5-gffdf"
May 23 22:15:32.451961 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.451921    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" event={"ID":"1fb89323-99c4-40e9-9598-c6b20f0212fd","Type":"ContainerStarted","Data":"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"}
May 23 22:15:32.452396 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.452139    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r6wd5"
May 23 22:15:32.468792 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.468755    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" podStartSLOduration=2.158697735 podStartE2EDuration="2.468743783s" podCreationTimestamp="2026-05-23 22:15:30 +0000 UTC" firstStartedPulling="2026-05-23 22:15:31.131662068 +0000 UTC m=+618.252252238" lastFinishedPulling="2026-05-23 22:15:31.441708112 +0000 UTC m=+618.562298286" observedRunningTime="2026-05-23 22:15:32.466696347 +0000 UTC m=+619.587286539" watchObservedRunningTime="2026-05-23 22:15:32.468743783 +0000 UTC m=+619.589333971"
May 23 22:15:32.493524 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.493493    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:32.493763 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.493739    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-r9jjd" podUID="279c2db1-0479-4a5f-ac83-9d16501c3691" containerName="authorino" containerID="cri-o://440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee" gracePeriod=30
May 23 22:15:32.501769 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.501698    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7696df7fc5-gffdf"]
May 23 22:15:32.504370 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.504142    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7696df7fc5-gffdf"]
May 23 22:15:32.524504 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.524477    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r6wd5"]
May 23 22:15:32.528511 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.528482    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r6wd5"]
May 23 22:15:32.739563 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.739542    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:32.856494 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.856454    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txs6x\" (UniqueName: \"kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x\") pod \"279c2db1-0479-4a5f-ac83-9d16501c3691\" (UID: \"279c2db1-0479-4a5f-ac83-9d16501c3691\") "
May 23 22:15:32.858437 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.858416    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x" (OuterVolumeSpecName: "kube-api-access-txs6x") pod "279c2db1-0479-4a5f-ac83-9d16501c3691" (UID: "279c2db1-0479-4a5f-ac83-9d16501c3691"). InnerVolumeSpecName "kube-api-access-txs6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:15:32.957280 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:32.957254    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txs6x\" (UniqueName: \"kubernetes.io/projected/279c2db1-0479-4a5f-ac83-9d16501c3691-kube-api-access-txs6x\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:15:33.456175 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.456140    2575 generic.go:358] "Generic (PLEG): container finished" podID="279c2db1-0479-4a5f-ac83-9d16501c3691" containerID="440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee" exitCode=0
May 23 22:15:33.456613 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.456189    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-r9jjd"
May 23 22:15:33.456613 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.456201    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-r9jjd" event={"ID":"279c2db1-0479-4a5f-ac83-9d16501c3691","Type":"ContainerDied","Data":"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"}
May 23 22:15:33.456613 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.456234    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-r9jjd" event={"ID":"279c2db1-0479-4a5f-ac83-9d16501c3691","Type":"ContainerDied","Data":"14c0cf0857f62f98e446dc3b021e0ebc93f8bc6e4440e85af3670e5b4b7d5286"}
May 23 22:15:33.456613 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.456249    2575 scope.go:117] "RemoveContainer" containerID="440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"
May 23 22:15:33.464213 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.464196    2575 scope.go:117] "RemoveContainer" containerID="440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"
May 23 22:15:33.464467 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:15:33.464441    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee\": container with ID starting with 440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee not found: ID does not exist" containerID="440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"
May 23 22:15:33.464533 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.464473    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee"} err="failed to get container status \"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee\": rpc error: code = NotFound desc = could not find container \"440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee\": container with ID starting with 440ec309d09b75a36f5d85d60cc0aa94bd233276ea49ae5ebee6e38261cda6ee not found: ID does not exist"
May 23 22:15:33.475345 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.475322    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71dfde52-7886-4227-b179-d7d56e9e7968" path="/var/lib/kubelet/pods/71dfde52-7886-4227-b179-d7d56e9e7968/volumes"
May 23 22:15:33.475549 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.475536    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb6b728-275c-4103-a731-eb72af97c188" path="/var/lib/kubelet/pods/ddb6b728-275c-4103-a731-eb72af97c188/volumes"
May 23 22:15:33.476321 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.476305    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:33.481551 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:33.481533    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-r9jjd"]
May 23 22:15:35.477530 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:15:35.477491    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279c2db1-0479-4a5f-ac83-9d16501c3691" path="/var/lib/kubelet/pods/279c2db1-0479-4a5f-ac83-9d16501c3691/volumes"
May 23 22:16:10.578436 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.578400    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"]
May 23 22:16:10.578861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.578723    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279c2db1-0479-4a5f-ac83-9d16501c3691" containerName="authorino"
May 23 22:16:10.578861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.578734    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="279c2db1-0479-4a5f-ac83-9d16501c3691" containerName="authorino"
May 23 22:16:10.578861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.578803    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="279c2db1-0479-4a5f-ac83-9d16501c3691" containerName="authorino"
May 23 22:16:10.581745 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.581730    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:10.584033 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.584010    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 23 22:16:10.592671 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.592643    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"]
May 23 22:16:10.682386 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.682355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9dw\" (UniqueName: \"kubernetes.io/projected/fe341275-1988-4713-9acc-2c69eff5d9a6-kube-api-access-tl9dw\") pod \"payload-processing-58b6c8fdc7-rjdxj\" (UID: \"fe341275-1988-4713-9acc-2c69eff5d9a6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:10.783422 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.783392    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9dw\" (UniqueName: \"kubernetes.io/projected/fe341275-1988-4713-9acc-2c69eff5d9a6-kube-api-access-tl9dw\") pod \"payload-processing-58b6c8fdc7-rjdxj\" (UID: \"fe341275-1988-4713-9acc-2c69eff5d9a6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:10.793452 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.793419    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9dw\" (UniqueName: \"kubernetes.io/projected/fe341275-1988-4713-9acc-2c69eff5d9a6-kube-api-access-tl9dw\") pod \"payload-processing-58b6c8fdc7-rjdxj\" (UID: \"fe341275-1988-4713-9acc-2c69eff5d9a6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:10.892816 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:10.892787    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:11.026268 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:11.026246    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"]
May 23 22:16:11.028347 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:16:11.028319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe341275_1988_4713_9acc_2c69eff5d9a6.slice/crio-9d101ededd7c6f154198f1ab0bb8ea5eac153bd6a6bd9838c168553dada933a5 WatchSource:0}: Error finding container 9d101ededd7c6f154198f1ab0bb8ea5eac153bd6a6bd9838c168553dada933a5: Status 404 returned error can't find the container with id 9d101ededd7c6f154198f1ab0bb8ea5eac153bd6a6bd9838c168553dada933a5
May 23 22:16:11.575135 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:11.575095    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj" event={"ID":"fe341275-1988-4713-9acc-2c69eff5d9a6","Type":"ContainerStarted","Data":"9d101ededd7c6f154198f1ab0bb8ea5eac153bd6a6bd9838c168553dada933a5"}
May 23 22:16:13.583593 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:13.583520    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj" event={"ID":"fe341275-1988-4713-9acc-2c69eff5d9a6","Type":"ContainerStarted","Data":"60f4856d8e2cf0249765801c7839c654c247741e2b9c8ca3b1b3c541878064f0"}
May 23 22:16:13.583948 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:13.583653    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:13.602697 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:13.602654    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj" podStartSLOduration=1.35268501 podStartE2EDuration="3.602642549s" podCreationTimestamp="2026-05-23 22:16:10 +0000 UTC" firstStartedPulling="2026-05-23 22:16:11.030116703 +0000 UTC m=+658.150706872" lastFinishedPulling="2026-05-23 22:16:13.280074225 +0000 UTC m=+660.400664411" observedRunningTime="2026-05-23 22:16:13.601724367 +0000 UTC m=+660.722314560" watchObservedRunningTime="2026-05-23 22:16:13.602642549 +0000 UTC m=+660.723232778"
May 23 22:16:24.588128 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:24.588094    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-rjdxj"
May 23 22:16:46.573283 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.573249    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"]
May 23 22:16:46.576774 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.576755    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.580975 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.580951    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 23 22:16:46.581138 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.581018    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 23 22:16:46.581138 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.581059    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 23 22:16:46.581138 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.581132    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ncnt\""
May 23 22:16:46.596574 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.596546    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"]
May 23 22:16:46.675331 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.675466 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.675466 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.675466 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a1c7f7-596d-49f3-97ef-c8cc78456f16-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.675566 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m8nq\" (UniqueName: \"kubernetes.io/projected/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kube-api-access-6m8nq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.675566 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.675528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.776669 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776637    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.776846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776686    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a1c7f7-596d-49f3-97ef-c8cc78456f16-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.776846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776723    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6m8nq\" (UniqueName: \"kubernetes.io/projected/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kube-api-access-6m8nq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.776846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776757    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.776846 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776807    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.777028 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.776846    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.777213 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.777186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.777323 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.777216    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.777323 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.777260    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.779038 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.779011    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a1c7f7-596d-49f3-97ef-c8cc78456f16-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.779311 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.779293    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a1c7f7-596d-49f3-97ef-c8cc78456f16-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.784220 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.784200    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m8nq\" (UniqueName: \"kubernetes.io/projected/00a1c7f7-596d-49f3-97ef-c8cc78456f16-kube-api-access-6m8nq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-zssr8\" (UID: \"00a1c7f7-596d-49f3-97ef-c8cc78456f16\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:46.886241 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:46.886213    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:16:47.016036 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:47.015986    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"]
May 23 22:16:47.018750 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:16:47.018721    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a1c7f7_596d_49f3_97ef_c8cc78456f16.slice/crio-b22c545cdeb3e34b8fe053eb34a4c2ceb1728cd4108b86cc95f6fd52ad92e3c4 WatchSource:0}: Error finding container b22c545cdeb3e34b8fe053eb34a4c2ceb1728cd4108b86cc95f6fd52ad92e3c4: Status 404 returned error can't find the container with id b22c545cdeb3e34b8fe053eb34a4c2ceb1728cd4108b86cc95f6fd52ad92e3c4
May 23 22:16:47.692335 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:47.692292    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8" event={"ID":"00a1c7f7-596d-49f3-97ef-c8cc78456f16","Type":"ContainerStarted","Data":"b22c545cdeb3e34b8fe053eb34a4c2ceb1728cd4108b86cc95f6fd52ad92e3c4"}
May 23 22:16:52.712142 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:16:52.712106    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8" event={"ID":"00a1c7f7-596d-49f3-97ef-c8cc78456f16","Type":"ContainerStarted","Data":"bb68f404cdbcfb90b34b42cb1d41f6b3b7370972b445631695dfd89b5f6ce192"}
May 23 22:17:00.742828 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:00.742794    2575 generic.go:358] "Generic (PLEG): container finished" podID="00a1c7f7-596d-49f3-97ef-c8cc78456f16" containerID="bb68f404cdbcfb90b34b42cb1d41f6b3b7370972b445631695dfd89b5f6ce192" exitCode=0
May 23 22:17:00.743200 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:00.742841    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8" event={"ID":"00a1c7f7-596d-49f3-97ef-c8cc78456f16","Type":"ContainerDied","Data":"bb68f404cdbcfb90b34b42cb1d41f6b3b7370972b445631695dfd89b5f6ce192"}
May 23 22:17:02.751338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:02.751307    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8" event={"ID":"00a1c7f7-596d-49f3-97ef-c8cc78456f16","Type":"ContainerStarted","Data":"d080d922cefb084610c59fc305453bb71415e69772f013dc6b02b2015d25ecfb"}
May 23 22:17:02.751858 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:02.751497    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:17:02.773146 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:02.772998    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8" podStartSLOduration=2.01806332 podStartE2EDuration="16.772978378s" podCreationTimestamp="2026-05-23 22:16:46 +0000 UTC" firstStartedPulling="2026-05-23 22:16:47.020678 +0000 UTC m=+694.141268170" lastFinishedPulling="2026-05-23 22:17:01.775593058 +0000 UTC m=+708.896183228" observedRunningTime="2026-05-23 22:17:02.76869203 +0000 UTC m=+709.889282221" watchObservedRunningTime="2026-05-23 22:17:02.772978378 +0000 UTC m=+709.893568572"
May 23 22:17:13.767558 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:13.767527    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-zssr8"
May 23 22:17:19.695876 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.695841    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"]
May 23 22:17:19.883472 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.883441    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"]
May 23 22:17:19.883630 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.883547    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.886161 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.886138    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 23 22:17:19.964791 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.964791 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.964910 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964801    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.964910 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmlc\" (UniqueName: \"kubernetes.io/projected/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kube-api-access-gzmlc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.964910 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a67ec-23d9-4586-affd-9591e60cdf5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:19.965082 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:19.964913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.065810 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065783    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.065918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065814    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.065918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065834    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.065918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065856    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmlc\" (UniqueName: \"kubernetes.io/projected/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kube-api-access-gzmlc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.065918 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065895    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a67ec-23d9-4586-affd-9591e60cdf5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.066154 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.065921    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.066210 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.066173    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.066269 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.066235    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.066307 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.066289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.068178 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.068157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0a67ec-23d9-4586-affd-9591e60cdf5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.068280 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.068263    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0a67ec-23d9-4586-affd-9591e60cdf5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.074092 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.074074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmlc\" (UniqueName: \"kubernetes.io/projected/7e0a67ec-23d9-4586-affd-9591e60cdf5d-kube-api-access-gzmlc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx\" (UID: \"7e0a67ec-23d9-4586-affd-9591e60cdf5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.193152 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.193131    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:20.318857 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.318795    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"]
May 23 22:17:20.321203 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:17:20.321178    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0a67ec_23d9_4586_affd_9591e60cdf5d.slice/crio-1e1cd76b70960d50b6ea6563449053bf484fb529730eef96b0cbc91deb8a07f9 WatchSource:0}: Error finding container 1e1cd76b70960d50b6ea6563449053bf484fb529730eef96b0cbc91deb8a07f9: Status 404 returned error can't find the container with id 1e1cd76b70960d50b6ea6563449053bf484fb529730eef96b0cbc91deb8a07f9
May 23 22:17:20.813000 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.812960    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx" event={"ID":"7e0a67ec-23d9-4586-affd-9591e60cdf5d","Type":"ContainerStarted","Data":"5807c3300b2c0dbcdee234ef60a9670bb7f64280158e9ee2235bc9184ed8d7a7"}
May 23 22:17:20.813396 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:20.813003    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx" event={"ID":"7e0a67ec-23d9-4586-affd-9591e60cdf5d","Type":"ContainerStarted","Data":"1e1cd76b70960d50b6ea6563449053bf484fb529730eef96b0cbc91deb8a07f9"}
May 23 22:17:25.832155 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:25.832077    2575 generic.go:358] "Generic (PLEG): container finished" podID="7e0a67ec-23d9-4586-affd-9591e60cdf5d" containerID="5807c3300b2c0dbcdee234ef60a9670bb7f64280158e9ee2235bc9184ed8d7a7" exitCode=0
May 23 22:17:25.832526 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:25.832150    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx" event={"ID":"7e0a67ec-23d9-4586-affd-9591e60cdf5d","Type":"ContainerDied","Data":"5807c3300b2c0dbcdee234ef60a9670bb7f64280158e9ee2235bc9184ed8d7a7"}
May 23 22:17:26.836519 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:26.836486    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx" event={"ID":"7e0a67ec-23d9-4586-affd-9591e60cdf5d","Type":"ContainerStarted","Data":"f27c2f319004960e825dc655630aa781259875b3f65dac34c0312d6e48cda949"}
May 23 22:17:26.836876 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:26.836694    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:26.856162 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:26.856118    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx" podStartSLOduration=7.699617702 podStartE2EDuration="7.856106325s" podCreationTimestamp="2026-05-23 22:17:19 +0000 UTC" firstStartedPulling="2026-05-23 22:17:25.832730719 +0000 UTC m=+732.953320888" lastFinishedPulling="2026-05-23 22:17:25.98921933 +0000 UTC m=+733.109809511" observedRunningTime="2026-05-23 22:17:26.853516984 +0000 UTC m=+733.974107180" watchObservedRunningTime="2026-05-23 22:17:26.856106325 +0000 UTC m=+733.976696517"
May 23 22:17:35.244227 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.244191    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b445697cd-7p2l4"]
May 23 22:17:35.248806 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.248789    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.256820 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.256798    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b445697cd-7p2l4"]
May 23 22:17:35.398379 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.398348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53fa3d6-0b1d-4515-8edf-656e5952d636-tls-cert\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.398517 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.398387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7pd\" (UniqueName: \"kubernetes.io/projected/c53fa3d6-0b1d-4515-8edf-656e5952d636-kube-api-access-bw7pd\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.499037 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.498972    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53fa3d6-0b1d-4515-8edf-656e5952d636-tls-cert\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.499037 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.499008    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7pd\" (UniqueName: \"kubernetes.io/projected/c53fa3d6-0b1d-4515-8edf-656e5952d636-kube-api-access-bw7pd\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.501360 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.501334    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c53fa3d6-0b1d-4515-8edf-656e5952d636-tls-cert\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.506583 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.506567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7pd\" (UniqueName: \"kubernetes.io/projected/c53fa3d6-0b1d-4515-8edf-656e5952d636-kube-api-access-bw7pd\") pod \"authorino-6b445697cd-7p2l4\" (UID: \"c53fa3d6-0b1d-4515-8edf-656e5952d636\") " pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.558517 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.558492    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b445697cd-7p2l4"
May 23 22:17:35.688512 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.688486    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b445697cd-7p2l4"]
May 23 22:17:35.690654 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:17:35.690630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc53fa3d6_0b1d_4515_8edf_656e5952d636.slice/crio-7c1267ebe4fac113bdb53eac21a4114cd03256431f09891bd5e03bd5956b6a05 WatchSource:0}: Error finding container 7c1267ebe4fac113bdb53eac21a4114cd03256431f09891bd5e03bd5956b6a05: Status 404 returned error can't find the container with id 7c1267ebe4fac113bdb53eac21a4114cd03256431f09891bd5e03bd5956b6a05
May 23 22:17:35.865816 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:35.865780    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b445697cd-7p2l4" event={"ID":"c53fa3d6-0b1d-4515-8edf-656e5952d636","Type":"ContainerStarted","Data":"7c1267ebe4fac113bdb53eac21a4114cd03256431f09891bd5e03bd5956b6a05"}
May 23 22:17:36.871039 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:36.870983    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b445697cd-7p2l4" event={"ID":"c53fa3d6-0b1d-4515-8edf-656e5952d636","Type":"ContainerStarted","Data":"428914c720b13f5eeff44fc779a611a7884c7c5d3d452a3c9bfe10483fe516e7"}
May 23 22:17:36.893695 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:36.893633    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6b445697cd-7p2l4" podStartSLOduration=1.444288257 podStartE2EDuration="1.893616042s" podCreationTimestamp="2026-05-23 22:17:35 +0000 UTC" firstStartedPulling="2026-05-23 22:17:35.692232727 +0000 UTC m=+742.812822898" lastFinishedPulling="2026-05-23 22:17:36.141560506 +0000 UTC m=+743.262150683" observedRunningTime="2026-05-23 22:17:36.892092411 +0000 UTC m=+744.012682605" watchObservedRunningTime="2026-05-23 22:17:36.893616042 +0000 UTC m=+744.014206233"
May 23 22:17:36.925385 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:36.925350    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:17:36.925651 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:36.925617    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" podUID="1fb89323-99c4-40e9-9598-c6b20f0212fd" containerName="authorino" containerID="cri-o://f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3" gracePeriod=30
May 23 22:17:37.167616 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.167596    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:17:37.314333 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.314298    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert\") pod \"1fb89323-99c4-40e9-9598-c6b20f0212fd\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") "
May 23 22:17:37.314477 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.314358    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7qsd\" (UniqueName: \"kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd\") pod \"1fb89323-99c4-40e9-9598-c6b20f0212fd\" (UID: \"1fb89323-99c4-40e9-9598-c6b20f0212fd\") "
May 23 22:17:37.316171 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.316145    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd" (OuterVolumeSpecName: "kube-api-access-j7qsd") pod "1fb89323-99c4-40e9-9598-c6b20f0212fd" (UID: "1fb89323-99c4-40e9-9598-c6b20f0212fd"). InnerVolumeSpecName "kube-api-access-j7qsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 23 22:17:37.324027 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.324003    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1fb89323-99c4-40e9-9598-c6b20f0212fd" (UID: "1fb89323-99c4-40e9-9598-c6b20f0212fd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 23 22:17:37.415746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.415678    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fb89323-99c4-40e9-9598-c6b20f0212fd-tls-cert\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:17:37.415746 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.415703    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7qsd\" (UniqueName: \"kubernetes.io/projected/1fb89323-99c4-40e9-9598-c6b20f0212fd-kube-api-access-j7qsd\") on node \"ip-10-0-137-7.ec2.internal\" DevicePath \"\""
May 23 22:17:37.851673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.851648    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx"
May 23 22:17:37.875364 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.875335    2575 generic.go:358] "Generic (PLEG): container finished" podID="1fb89323-99c4-40e9-9598-c6b20f0212fd" containerID="f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3" exitCode=0
May 23 22:17:37.875779 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.875376    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655f8d94c9-pnkl7"
May 23 22:17:37.875779 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.875413    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" event={"ID":"1fb89323-99c4-40e9-9598-c6b20f0212fd","Type":"ContainerDied","Data":"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"}
May 23 22:17:37.875779 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.875451    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655f8d94c9-pnkl7" event={"ID":"1fb89323-99c4-40e9-9598-c6b20f0212fd","Type":"ContainerDied","Data":"c652f088590e7002005a952d3959f1d3fd36aefc740d42b70087e21f03d20236"}
May 23 22:17:37.875779 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.875472    2575 scope.go:117] "RemoveContainer" containerID="f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"
May 23 22:17:37.884650 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.884634    2575 scope.go:117] "RemoveContainer" containerID="f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"
May 23 22:17:37.884915 ip-10-0-137-7 kubenswrapper[2575]: E0523 22:17:37.884896    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3\": container with ID starting with f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3 not found: ID does not exist" containerID="f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"
May 23 22:17:37.884984 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.884931    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3"} err="failed to get container status \"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3\": rpc error: code = NotFound desc = could not find container \"f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3\": container with ID starting with f16456fe6b1be5e249b14acccaccff5742f5b1175f6e1ff00ff741be223237d3 not found: ID does not exist"
May 23 22:17:37.900002 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.899978    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:17:37.906172 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:37.906147    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-655f8d94c9-pnkl7"]
May 23 22:17:39.476303 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:17:39.476269    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb89323-99c4-40e9-9598-c6b20f0212fd" path="/var/lib/kubelet/pods/1fb89323-99c4-40e9-9598-c6b20f0212fd/volumes"
May 23 22:20:13.445088 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:20:13.445062    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:20:13.447256 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:20:13.447235    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:25:13.469191 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:25:13.469161    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:25:13.471683 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:25:13.471661    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:30:13.493250 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:30:13.493221    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:30:13.499726 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:30:13.499705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:35:13.515693 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:35:13.515664    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:35:13.523900 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:35:13.523881    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:40:02.013986 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:02.013956    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b445697cd-7p2l4_c53fa3d6-0b1d-4515-8edf-656e5952d636/authorino/0.log"
May 23 22:40:07.090676 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:07.090641    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696794d4d9-swdqj_bec686f0-5b57-4fa3-80a7-bf02d81fa2ac/manager/0.log"
May 23 22:40:08.372374 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:08.372334    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b445697cd-7p2l4_c53fa3d6-0b1d-4515-8edf-656e5952d636/authorino/0.log"
May 23 22:40:08.681771 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:08.681701    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-ns9cj_ed1295aa-3286-44d9-84fc-f35026220af2/kuadrant-console-plugin/0.log"
May 23 22:40:09.757818 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:09.757789    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f475c6cf-zlwkb_afe26eec-33b9-415f-8ecb-4819d016271d/kube-auth-proxy/0.log"
May 23 22:40:09.979152 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:09.979122    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rjdxj_fe341275-1988-4713-9acc-2c69eff5d9a6/payload-processing/0.log"
May 23 22:40:10.081014 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:10.080934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77d7b4dfd8-7pvr9_26d79e61-a1b9-4fd1-a8c7-fe661f5d7719/router/0.log"
May 23 22:40:10.749483 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:10.749455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx_7e0a67ec-23d9-4586-affd-9591e60cdf5d/storage-initializer/0.log"
May 23 22:40:10.759401 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:10.759381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccbsppx_7e0a67ec-23d9-4586-affd-9591e60cdf5d/main/0.log"
May 23 22:40:10.984610 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:10.984581    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-zssr8_00a1c7f7-596d-49f3-97ef-c8cc78456f16/storage-initializer/0.log"
May 23 22:40:10.992946 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:10.992926    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-zssr8_00a1c7f7-596d-49f3-97ef-c8cc78456f16/main/0.log"
May 23 22:40:13.546698 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:13.546672    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:40:13.554363 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:13.554342    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:40:14.745540 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.745507    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p5st4/must-gather-bvr68"]
May 23 22:40:14.745896 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.745873    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb89323-99c4-40e9-9598-c6b20f0212fd" containerName="authorino"
May 23 22:40:14.745896 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.745884    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb89323-99c4-40e9-9598-c6b20f0212fd" containerName="authorino"
May 23 22:40:14.745965 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.745938    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fb89323-99c4-40e9-9598-c6b20f0212fd" containerName="authorino"
May 23 22:40:14.749136 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.749119    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.751728 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.751700    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p5st4\"/\"openshift-service-ca.crt\""
May 23 22:40:14.752765 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.752745    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p5st4\"/\"kube-root-ca.crt\""
May 23 22:40:14.752876 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.752745    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p5st4\"/\"default-dockercfg-4jg8q\""
May 23 22:40:14.767078 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.767040    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/must-gather-bvr68"]
May 23 22:40:14.878884 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.878835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8dtf\" (UniqueName: \"kubernetes.io/projected/06e27659-1702-47b1-aa14-bfcb096cd5db-kube-api-access-g8dtf\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.879079 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.878912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e27659-1702-47b1-aa14-bfcb096cd5db-must-gather-output\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.980068 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.980019    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8dtf\" (UniqueName: \"kubernetes.io/projected/06e27659-1702-47b1-aa14-bfcb096cd5db-kube-api-access-g8dtf\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.980172 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.980096    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e27659-1702-47b1-aa14-bfcb096cd5db-must-gather-output\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.980414 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.980391    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06e27659-1702-47b1-aa14-bfcb096cd5db-must-gather-output\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:14.988155 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:14.988127    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8dtf\" (UniqueName: \"kubernetes.io/projected/06e27659-1702-47b1-aa14-bfcb096cd5db-kube-api-access-g8dtf\") pod \"must-gather-bvr68\" (UID: \"06e27659-1702-47b1-aa14-bfcb096cd5db\") " pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:15.058374 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:15.058306    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/must-gather-bvr68"
May 23 22:40:15.188155 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:15.188128    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/must-gather-bvr68"]
May 23 22:40:15.190311 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:40:15.190272    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06e27659_1702_47b1_aa14_bfcb096cd5db.slice/crio-3ca073236fd1a37f2962afd94f8f51dcbfaa1471637bad52b8c9c572678c9559 WatchSource:0}: Error finding container 3ca073236fd1a37f2962afd94f8f51dcbfaa1471637bad52b8c9c572678c9559: Status 404 returned error can't find the container with id 3ca073236fd1a37f2962afd94f8f51dcbfaa1471637bad52b8c9c572678c9559
May 23 22:40:15.192075 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:15.192061    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 23 22:40:15.387851 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:15.387812    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/must-gather-bvr68" event={"ID":"06e27659-1702-47b1-aa14-bfcb096cd5db","Type":"ContainerStarted","Data":"3ca073236fd1a37f2962afd94f8f51dcbfaa1471637bad52b8c9c572678c9559"}
May 23 22:40:16.395430 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:16.395217    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/must-gather-bvr68" event={"ID":"06e27659-1702-47b1-aa14-bfcb096cd5db","Type":"ContainerStarted","Data":"21e0cdeadb5fb4d7118958b04abce5f3710b72a7a0ce42c0c1f7636aacf3a4f8"}
May 23 22:40:16.395430 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:16.395266    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/must-gather-bvr68" event={"ID":"06e27659-1702-47b1-aa14-bfcb096cd5db","Type":"ContainerStarted","Data":"8fd0cfe7d38fef2ad6ec7696801b4183fc4102b958a824823cb974b2d10b8bb7"}
May 23 22:40:16.412608 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:16.412543    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p5st4/must-gather-bvr68" podStartSLOduration=1.630170035 podStartE2EDuration="2.412521373s" podCreationTimestamp="2026-05-23 22:40:14 +0000 UTC" firstStartedPulling="2026-05-23 22:40:15.19218395 +0000 UTC m=+2102.312774124" lastFinishedPulling="2026-05-23 22:40:15.974535291 +0000 UTC m=+2103.095125462" observedRunningTime="2026-05-23 22:40:16.409528989 +0000 UTC m=+2103.530119198" watchObservedRunningTime="2026-05-23 22:40:16.412521373 +0000 UTC m=+2103.533111567"
May 23 22:40:17.609921 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:17.609887    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rmvmn_45797fbd-cd55-4a94-a8d5-f2ec2812f644/global-pull-secret-syncer/0.log"
May 23 22:40:17.651378 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:17.651331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9cbft_0ab5905c-3a59-4020-9eff-e9fd7377822f/konnectivity-agent/0.log"
May 23 22:40:17.752187 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:17.752151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-7.ec2.internal_2cb67e3ce093f11801888ffea920b426/haproxy/0.log"
May 23 22:40:22.095673 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:22.095640    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b445697cd-7p2l4_c53fa3d6-0b1d-4515-8edf-656e5952d636/authorino/0.log"
May 23 22:40:22.173578 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:22.173068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-ns9cj_ed1295aa-3286-44d9-84fc-f35026220af2/kuadrant-console-plugin/0.log"
May 23 22:40:23.763875 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.763838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/alertmanager/0.log"
May 23 22:40:23.789510 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.789432    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/config-reloader/0.log"
May 23 22:40:23.808354 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.808329    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/kube-rbac-proxy-web/0.log"
May 23 22:40:23.827943 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.827910    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/kube-rbac-proxy/0.log"
May 23 22:40:23.847699 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.847668    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/kube-rbac-proxy-metric/0.log"
May 23 22:40:23.868989 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.868966    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/prom-label-proxy/0.log"
May 23 22:40:23.890743 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:23.890700    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4c73d02a-eed8-4e38-956a-302dd67b6326/init-config-reloader/0.log"
May 23 22:40:24.029217 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.029141    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8577d958c-dsq25_b1039fbf-337f-493b-9a32-1cdb43018dca/metrics-server/0.log"
May 23 22:40:24.051521 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.051493    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-xgj2b_41d7b6b6-c0b7-4701-ab1c-9e87787ec57e/monitoring-plugin/0.log"
May 23 22:40:24.149739 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.149714    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc2cx_cbc683f8-1ba6-49d3-ab57-80ad682a53e6/node-exporter/0.log"
May 23 22:40:24.170960 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.170928    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc2cx_cbc683f8-1ba6-49d3-ab57-80ad682a53e6/kube-rbac-proxy/0.log"
May 23 22:40:24.187649 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.187617    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dc2cx_cbc683f8-1ba6-49d3-ab57-80ad682a53e6/init-textfile/0.log"
May 23 22:40:24.347385 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.347356    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/prometheus/0.log"
May 23 22:40:24.375677 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.375617    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/config-reloader/0.log"
May 23 22:40:24.430446 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.430417    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/thanos-sidecar/0.log"
May 23 22:40:24.472581 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.472553    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/kube-rbac-proxy-web/0.log"
May 23 22:40:24.490479 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.490441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/kube-rbac-proxy/0.log"
May 23 22:40:24.508341 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.508316    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/kube-rbac-proxy-thanos/0.log"
May 23 22:40:24.526897 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.526874    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ccf8b7-7585-420c-881d-2b9eaa2fce69/init-config-reloader/0.log"
May 23 22:40:24.592901 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.592871    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-jwqwf_706f70be-3caa-449e-841b-4b709b57a14a/prometheus-operator-admission-webhook/0.log"
May 23 22:40:24.618863 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.618760    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f647f76c6-bs5zr_76d30517-3d41-4b35-b0d9-2f9f763fc34d/telemeter-client/0.log"
May 23 22:40:24.635948 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.635921    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f647f76c6-bs5zr_76d30517-3d41-4b35-b0d9-2f9f763fc34d/reload/0.log"
May 23 22:40:24.654800 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:24.654773    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f647f76c6-bs5zr_76d30517-3d41-4b35-b0d9-2f9f763fc34d/kube-rbac-proxy/0.log"
May 23 22:40:25.763908 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:25.763881    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-g7462_b256ce02-37bd-4bc3-a314-341352cd9f23/networking-console-plugin/0.log"
May 23 22:40:26.062275 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.062198    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"]
May 23 22:40:26.068302 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.068271    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.075400 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.075360    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"]
May 23 22:40:26.210778 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.210738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-lib-modules\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.210778 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.210784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-podres\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.211020 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.210841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ttrd\" (UniqueName: \"kubernetes.io/projected/6224cc3c-723d-436f-8509-5a58bc990bdb-kube-api-access-4ttrd\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.211020 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.210929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-sys\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.211020 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.210970    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-proc\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312406 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312310    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-lib-modules\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312406 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312368    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-podres\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312650 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312428    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ttrd\" (UniqueName: \"kubernetes.io/projected/6224cc3c-723d-436f-8509-5a58bc990bdb-kube-api-access-4ttrd\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312650 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312467    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-sys\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312650 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312511    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-proc\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312650 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312607    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-proc\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312731    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-lib-modules\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.312869 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.312815    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-podres\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.313205 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.313178    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6224cc3c-723d-436f-8509-5a58bc990bdb-sys\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.321041 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.321014    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ttrd\" (UniqueName: \"kubernetes.io/projected/6224cc3c-723d-436f-8509-5a58bc990bdb-kube-api-access-4ttrd\") pod \"perf-node-gather-daemonset-hlf9l\" (UID: \"6224cc3c-723d-436f-8509-5a58bc990bdb\") " pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.385145 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.385111    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:26.542683 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:26.542630    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"]
May 23 22:40:26.553107 ip-10-0-137-7 kubenswrapper[2575]: W0523 22:40:26.551943    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6224cc3c_723d_436f_8509_5a58bc990bdb.slice/crio-847d069af1ed303a5feb1c5a5293ae02e7753c92e4eb16a925ed9606c0f71af9 WatchSource:0}: Error finding container 847d069af1ed303a5feb1c5a5293ae02e7753c92e4eb16a925ed9606c0f71af9: Status 404 returned error can't find the container with id 847d069af1ed303a5feb1c5a5293ae02e7753c92e4eb16a925ed9606c0f71af9
May 23 22:40:27.188338 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.188308    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-hhn45_146c8ad9-2a57-43dd-a51d-beb359d23c24/volume-data-source-validator/0.log"
May 23 22:40:27.446534 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.446450    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l" event={"ID":"6224cc3c-723d-436f-8509-5a58bc990bdb","Type":"ContainerStarted","Data":"9d2bcf65694edb8ba7d777eb0a81d88918f8d29d3982a36b715016573ba6238c"}
May 23 22:40:27.446534 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.446498    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l" event={"ID":"6224cc3c-723d-436f-8509-5a58bc990bdb","Type":"ContainerStarted","Data":"847d069af1ed303a5feb1c5a5293ae02e7753c92e4eb16a925ed9606c0f71af9"}
May 23 22:40:27.446748 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.446588    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:27.463227 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.463186    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l" podStartSLOduration=1.46317252 podStartE2EDuration="1.46317252s" podCreationTimestamp="2026-05-23 22:40:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-23 22:40:27.461521615 +0000 UTC m=+2114.582111818" watchObservedRunningTime="2026-05-23 22:40:27.46317252 +0000 UTC m=+2114.583762722"
May 23 22:40:27.907117 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.907067    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cslgq_c26e358d-e1a7-4fbb-8ac8-12dc563321c8/dns/0.log"
May 23 22:40:27.922803 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:27.922780    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cslgq_c26e358d-e1a7-4fbb-8ac8-12dc563321c8/kube-rbac-proxy/0.log"
May 23 22:40:28.030553 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:28.030526    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9m6t7_3ff0be26-9ebe-4e5f-a250-c041d8255449/dns-node-resolver/0.log"
May 23 22:40:28.470411 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:28.470382    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6db86fd659-j7mmf_20be67b8-324d-4db2-a7f0-a6a6b992aaa5/registry/0.log"
May 23 22:40:28.485743 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:28.485713    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kf9d_2c5f355a-f160-4c7c-8d90-f01a17e78672/node-ca/0.log"
May 23 22:40:29.450304 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:29.450278    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f475c6cf-zlwkb_afe26eec-33b9-415f-8ecb-4819d016271d/kube-auth-proxy/0.log"
May 23 22:40:29.572216 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:29.572183    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-rjdxj_fe341275-1988-4713-9acc-2c69eff5d9a6/payload-processing/0.log"
May 23 22:40:29.589616 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:29.589592    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77d7b4dfd8-7pvr9_26d79e61-a1b9-4fd1-a8c7-fe661f5d7719/router/0.log"
May 23 22:40:30.076788 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:30.076757    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nqmll_8553bc5b-9f0b-4332-a907-6a53c6868446/serve-healthcheck-canary/0.log"
May 23 22:40:30.575861 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:30.575830    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5x74_0f0d6982-a170-494c-9e63-6e94a02a1459/kube-rbac-proxy/0.log"
May 23 22:40:30.592267 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:30.592248    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5x74_0f0d6982-a170-494c-9e63-6e94a02a1459/exporter/0.log"
May 23 22:40:30.612278 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:30.612254    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p5x74_0f0d6982-a170-494c-9e63-6e94a02a1459/extractor/0.log"
May 23 22:40:32.776765 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:32.776732    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696794d4d9-swdqj_bec686f0-5b57-4fa3-80a7-bf02d81fa2ac/manager/0.log"
May 23 22:40:33.460957 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:33.460928    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p5st4/perf-node-gather-daemonset-hlf9l"
May 23 22:40:33.861723 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:33.861698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bf4fb87f5-w5rwk_cfa77285-f959-48e7-b6dd-e643cc714edb/manager/0.log"
May 23 22:40:39.310895 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.310865    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/kube-multus-additional-cni-plugins/0.log"
May 23 22:40:39.328413 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.328385    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/egress-router-binary-copy/0.log"
May 23 22:40:39.345514 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.345490    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/cni-plugins/0.log"
May 23 22:40:39.368414 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.368393    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/bond-cni-plugin/0.log"
May 23 22:40:39.386391 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.386373    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/routeoverride-cni/0.log"
May 23 22:40:39.402278 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.402260    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/whereabouts-cni-bincopy/0.log"
May 23 22:40:39.418382 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.418368    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4qqxb_cb04e5a7-5197-4a6e-9194-2b401f159673/whereabouts-cni/0.log"
May 23 22:40:39.728707 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.728682    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zfbv6_a2a87229-f96a-4186-aafb-5d663fc8aa01/kube-multus/0.log"
May 23 22:40:39.805916 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.805888    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d9hx9_8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8/network-metrics-daemon/0.log"
May 23 22:40:39.825836 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:39.825814    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d9hx9_8ff2d8ee-7af5-4d42-9a60-f38fdaa305f8/kube-rbac-proxy/0.log"
May 23 22:40:41.136203 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.136168    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-controller/0.log"
May 23 22:40:41.149928 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.149895    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/0.log"
May 23 22:40:41.161510 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.161487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovn-acl-logging/1.log"
May 23 22:40:41.177370 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.177351    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/kube-rbac-proxy-node/0.log"
May 23 22:40:41.193095 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.193043    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/kube-rbac-proxy-ovn-metrics/0.log"
May 23 22:40:41.206438 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.206420    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/northd/0.log"
May 23 22:40:41.222797 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.222776    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/nbdb/0.log"
May 23 22:40:41.239364 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.239347    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/sbdb/0.log"
May 23 22:40:41.336257 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:41.336227    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwsp5_78db2e6c-0f35-44b4-bad4-862d3df87bbc/ovnkube-controller/0.log"
May 23 22:40:42.401931 ip-10-0-137-7 kubenswrapper[2575]: I0523 22:40:42.401862    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-86c5b_23bb4542-3311-4344-a19b-075537fba37c/network-check-target-container/0.log"