May 20 20:46:02.236942 ip-10-0-138-50 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 20 20:46:02.236955 ip-10-0-138-50 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 20 20:46:02.236964 ip-10-0-138-50 systemd[1]: kubelet.service: Failed with result 'resources'.
May 20 20:46:02.237284 ip-10-0-138-50 systemd[1]: Failed to start Kubernetes Kubelet.
May 20 20:46:12.477762 ip-10-0-138-50 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 20 20:46:12.477777 ip-10-0-138-50 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2e17311d58854d6c932e284e7929e03f --
May 20 20:48:35.499367 ip-10-0-138-50 systemd[1]: Starting Kubernetes Kubelet...
May 20 20:48:35.903634 ip-10-0-138-50 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:35.903634 ip-10-0-138-50 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 20:48:35.903634 ip-10-0-138-50 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:35.903634 ip-10-0-138-50 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 20:48:35.903634 ip-10-0-138-50 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:35.905947 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.905859    2554 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912883    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912901    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912905    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912909    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912912    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:35.912907 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912915    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912918    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912922    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912925    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912928    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912930    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912933    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912935    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912938    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912940    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912943    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912945    2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912949    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912951    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912954    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912957    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912959    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912962    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912966    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912971    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:35.913154 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912974    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912978    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912980    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912983    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912985    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912988    2554 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912991    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912993    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912996    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.912998    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913000    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913003    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913005    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913008    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913011    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913014    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913017    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913020    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913022    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913025    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:35.913636 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913028    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913031    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913034    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913036    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913039    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913042    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913045    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913047    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913050    2554 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913052    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913055    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913057    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913060    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913075    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913078    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913081    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913083    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913086    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913089    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913092    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:35.914137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913094    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913097    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913099    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913102    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913104    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913107    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913112    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913114    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913117    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913122    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913126    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913129    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913132    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913135    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913137    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913140    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913143    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913145    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913148    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:35.914632 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913150    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.913153    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914759    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914766    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914769    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914772    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914775    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914779    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914782    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914785    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914788    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914791    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914794    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914797    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914799    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914802    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914805    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914808    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914810    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914813    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:35.915100 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914816    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914818    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914821    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914823    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914826    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914828    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914832    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914834    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914837    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914839    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914841    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914844    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914846    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914849    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914852    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914855    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914857    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914860    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914862    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914865    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:35.915590 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914867    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914870    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914873    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914876    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914878    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914881    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914883    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914886    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914888    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914891    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914894    2554 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914896    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914898    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914902    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914905    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914907    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914910    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914912    2554 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914916    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914919    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:35.916222 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914922    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914924    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914927    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914929    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914932    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914935    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914939    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914943    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914946    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914948    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914951    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914954    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914956    2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914959    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914961    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914963    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914966    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914969    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914972    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:35.916713 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914975    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914978    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914980    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914982    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914985    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914987    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914990    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914992    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.914995    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915080    2554 flags.go:64] FLAG: --address="0.0.0.0"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915089    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915098    2554 flags.go:64] FLAG: --anonymous-auth="true"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915102    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915109    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915124    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915129    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915134    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915137    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915140    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915143    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915147    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915150    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 20:48:35.917207 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915153    2554 flags.go:64] FLAG: --cgroup-root=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915156    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915159    2554 flags.go:64] FLAG: --client-ca-file=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915162    2554 flags.go:64] FLAG: --cloud-config=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915164    2554 flags.go:64] FLAG: --cloud-provider="external"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915167    2554 flags.go:64] FLAG: --cluster-dns="[]"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915172    2554 flags.go:64] FLAG: --cluster-domain=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915175    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915178    2554 flags.go:64] FLAG: --config-dir=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915181    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915184    2554 flags.go:64] FLAG: --container-log-max-files="5"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915188    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915191    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915194    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915197    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915200    2554 flags.go:64] FLAG: --contention-profiling="false"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915203    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915206    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915209    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915212    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915216    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915222    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915225    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915228    2554 flags.go:64] FLAG: --enable-load-reader="false"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915233    2554 flags.go:64] FLAG: --enable-server="true"
May 20 20:48:35.917757 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915236    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915240    2554 flags.go:64] FLAG: --event-burst="100"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915243    2554 flags.go:64] FLAG: --event-qps="50"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915246    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915249    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915252    2554 flags.go:64] FLAG: --eviction-hard=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915256    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915259    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915262    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915265    2554 flags.go:64] FLAG: --eviction-soft=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915267    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915271    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915273    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915276    2554 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915279    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915282    2554 flags.go:64] FLAG: --fail-swap-on="true"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915285    2554 flags.go:64] FLAG: --feature-gates=""
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915289    2554 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915292    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915295    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915298    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915301    2554 flags.go:64] FLAG: --healthz-port="10248"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915304    2554 flags.go:64] FLAG: --help="false"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915307    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-138-50.ec2.internal"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915310    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 20:48:35.918376 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915313    2554 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915316    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915319    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915324    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915327    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915330    2554 flags.go:64] FLAG: --image-service-endpoint=""
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915333    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915336    2554 flags.go:64] FLAG: --kube-api-burst="100"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915339    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915342    2554 flags.go:64] FLAG: --kube-api-qps="50"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915345    2554 flags.go:64] FLAG: --kube-reserved=""
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915348    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915351    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915354    2554 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915357    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915359    2554 flags.go:64] FLAG: --lock-file=""
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915362    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915365    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915368    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915373    2554 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915376    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915379    2554 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915382    2554 flags.go:64] FLAG: --logging-format="text"
May 20 20:48:35.918970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915385    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915388    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915391    2554 flags.go:64] FLAG: --manifest-url=""
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915393    2554 flags.go:64] FLAG: --manifest-url-header=""
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915398    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915401    2554 flags.go:64] FLAG: --max-open-files="1000000"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915405    2554 flags.go:64] FLAG: --max-pods="110"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915408    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915411    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915413    2554 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915416    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915419    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915423    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915426    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915434    2554 flags.go:64] FLAG: --node-status-max-images="50"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915437    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915440    2554 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915444    2554 flags.go:64] FLAG: --pod-cidr=""
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915447    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915453    2554 flags.go:64] FLAG: --pod-manifest-path=""
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915456    2554 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915460    2554 flags.go:64] FLAG: --pods-per-core="0"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915463    2554 flags.go:64] FLAG: --port="10250"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915466    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 20:48:35.919550 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915468    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c45bc9b3ef945787"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915471    2554 flags.go:64] FLAG: --qos-reserved=""
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915475    2554 flags.go:64] FLAG: --read-only-port="10255"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915478    2554 flags.go:64] FLAG: --register-node="true"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915481    2554 flags.go:64] FLAG: --register-schedulable="true"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915483    2554 flags.go:64] FLAG: --register-with-taints=""
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915487    2554 flags.go:64] FLAG: --registry-burst="10"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915490    2554 flags.go:64] FLAG: --registry-qps="5"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915493    2554 flags.go:64] FLAG: --reserved-cpus=""
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915496    2554 flags.go:64] FLAG: --reserved-memory=""
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915502    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915505    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915508    2554 flags.go:64] FLAG: --rotate-certificates="false"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915511    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915513    2554 flags.go:64] FLAG: --runonce="false"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915516    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915519    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915522    2554 flags.go:64] FLAG: --seccomp-default="false"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915525    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915528    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915532    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915535    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915538    2554 flags.go:64] FLAG: --storage-driver-password="root"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915541    2554 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915544    2554 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915547    2554 flags.go:64] FLAG: --storage-driver-user="root"
May 20 20:48:35.920147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915551    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915555    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915558    2554 flags.go:64] FLAG: --system-cgroups=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915560    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915566    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915568    2554 flags.go:64] FLAG: --tls-cert-file=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915571    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915576    2554 flags.go:64] FLAG: --tls-min-version=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915579    2554 flags.go:64] FLAG: --tls-private-key-file=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915582    2554 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915585    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915588    2554 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915591    2554 flags.go:64] FLAG: --v="2"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915595    2554 flags.go:64] FLAG: --version="false"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915599    2554 flags.go:64] FLAG: --vmodule=""
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915603    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.915607    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915695    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915699    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915702    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915705    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915708    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915711    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915713    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:35.920804 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915716    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915719    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915722    2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915725    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915727    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915730    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915732    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915735    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915737    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915740    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915743    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915745    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915748    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915750    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915753    2554 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915756    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915758    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915761    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915763    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915765    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:35.921410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915768    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915770    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915773    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915775    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915778    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915780    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915783    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915785    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915788    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915790    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915793    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915795    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915799    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915803    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915806    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915809    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915811    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915817    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915820    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:35.921931 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915823    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915827    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915829    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915833    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915835    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915838    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915841    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915843    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915846    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915848    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915851    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915854    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915856    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915859    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915861    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915863    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915866    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915868    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915871    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915873    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:35.922428 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915876    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915878    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915882    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915885    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915887    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915890    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915892    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915895    2554 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915898    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915900    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915904    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915906    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915909    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915911    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915914    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915917    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915920    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915923    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915925    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:35.922906 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.915928    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.916524    2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.922852    2554 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.922868    2554 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922921    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922926    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922929    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922932    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922935    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922938    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922940    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922943    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922946    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922948    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922951    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922954    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:35.923400 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922956    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922959    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922961    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922964    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922966    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922969    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922972    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922975    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922978    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922980    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922983    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922985    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922988    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922990    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922993    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922995    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.922998    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923001    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923003    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:35.923799 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923007    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923010    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923012    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923015    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923017    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923020    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923022    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923025    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923028    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923030    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923033    2554 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923035    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923038    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923040    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923043    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923045    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923048    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923050    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923053    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923055    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:35.924318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923058    2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923060    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923078    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923081    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923084    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923087    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923089    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923093    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923096    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923099    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923102    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923105    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923108    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923124    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923128    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923131    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923134    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923136    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923139    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923142    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:35.924794 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923144    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923147    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923149    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923152    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923154    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923157    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923160    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923162    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923167    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923171    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923174    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923177    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923180    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923183    2554 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923186    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:35.925297 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.923191    2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923294    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923299    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923302    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923305    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923308    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923311    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923313    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923316    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923319    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923322    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923325    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923328    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923331    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923333    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923336    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923339    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923341    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923344    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923347    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:35.925665 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923349    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923352    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923354    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923357    2554 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923359    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923362    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923364    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923367    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923369    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923372    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923375    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923377    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923380    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923383    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923385    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923388    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923390    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923393    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923395    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923398    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:35.926170 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923400    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923403    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923406    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923409    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923412    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923415    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923418    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923420    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923422    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923425    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923427    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923430    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923432    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923435    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923437    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923440    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923442    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923445    2554 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923447    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923450    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:35.926687 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923452    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923455    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923457    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923460    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923462    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923464    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923467    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923469    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923471    2554 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923475    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923479    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923481    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923485    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923488    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923491    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923494    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923497    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923507    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923510    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:35.927201 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923512    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923515    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923518    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923520    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923523    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923526    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923530    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:35.923532    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.923537    2554 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.924293    2554 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.926276    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.927205    2554 server.go:1019] "Starting client certificate rotation"
May 20 20:48:35.927692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.927303    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:48:35.928110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.928087    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:48:35.950523 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.950503    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:48:35.954410 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.954389    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:48:35.967246 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.967223    2554 log.go:25] "Validated CRI v1 runtime API"
May 20 20:48:35.972241 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.972222    2554 log.go:25] "Validated CRI v1 image API"
May 20 20:48:35.973499 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.973484    2554 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 20:48:35.976289 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.976259    2554 fs.go:135] Filesystem UUIDs: map[02549f77-b34c-4446-a6bd-66d802cee848:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d92241c1-2ceb-4ce5-98da-e740d6ebbbe8:/dev/nvme0n1p3]
May 20 20:48:35.976365 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.976286    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 20:48:35.979271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.979247    2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:48:35.980580 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.980467    2554 manager.go:217] Machine: {Timestamp:2026-05-20 20:48:35.979971656 +0000 UTC m=+0.373123470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098398 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7f3f0493754a28ae0000dd71a40f SystemUUID:ec2f7f3f-0493-754a-28ae-0000dd71a40f BootID:2e17311d-5885-4d6c-932e-284e7929e03f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:1c:18:73:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:1c:18:73:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:af:94:50:2c:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 20:48:35.981234 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.981221    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 20:48:35.981343 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.981328    2554 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 20:48:35.984905 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.984880    2554 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 20:48:35.985041 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.984907    2554 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 20:48:35.985098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.985051    2554 topology_manager.go:138] "Creating topology manager with none policy"
May 20 20:48:35.985098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.985059    2554 container_manager_linux.go:306] "Creating device plugin manager"
May 20 20:48:35.985098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.985084    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:48:35.985711 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.985700    2554 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:48:35.987449 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.987438    2554 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:48:35.987568 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.987559    2554 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 20:48:35.990718 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.990708    2554 kubelet.go:491] "Attempting to sync node with API server"
May 20 20:48:35.990751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.990722    2554 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 20:48:35.990751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.990735    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 20:48:35.990751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.990743    2554 kubelet.go:397] "Adding apiserver pod source"
May 20 20:48:35.990751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.990752    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 20:48:35.991715 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.991700    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:48:35.991791 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.991719    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:48:35.994751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.994734    2554 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 20:48:35.996531 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.996516    2554 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 20:48:35.997329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997306    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 20:48:35.997329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997323    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 20:48:35.997329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997329    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997336    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997356    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997364    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997369    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997375    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997382    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997387    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 20:48:35.997477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997404    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 20:48:35.997673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.997644    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 20:48:35.999160 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.999146    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 20:48:35.999160 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:35.999160    2554 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 20:48:36.002616 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.002598    2554 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 20:48:36.002692 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.002637    2554 server.go:1295] "Started kubelet"
May 20 20:48:36.002799 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.002735    2554 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 20:48:36.002859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.002819    2554 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 20:48:36.002945 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.002917    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 20:48:36.003507 ip-10-0-138-50 systemd[1]: Started Kubernetes Kubelet.
May 20 20:48:36.007266 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.007243    2554 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 20:48:36.007517 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.007466    2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 20:48:36.007613 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.007543    2554 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-50.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 20:48:36.007613 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.007597    2554 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 20:48:36.008545 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.008526    2554 server.go:317] "Adding debug handlers to kubelet server"
May 20 20:48:36.013235 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.013198    2554 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 20:48:36.014044 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.013217    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-50.ec2.internal.18b1611f919841a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-50.ec2.internal,UID:ip-10-0-138-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-50.ec2.internal,},FirstTimestamp:2026-05-20 20:48:36.002611617 +0000 UTC m=+0.395763429,LastTimestamp:2026-05-20 20:48:36.002611617 +0000 UTC m=+0.395763429,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-50.ec2.internal,}"
May 20 20:48:36.014662 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.014650    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 20:48:36.015169 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015152    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 20:48:36.015345 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015328    2554 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 20:48:36.015345 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015349    2554 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 20:48:36.015475 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015463    2554 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 20:48:36.015556 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015544    2554 reconstruct.go:97] "Volume reconstruction finished"
May 20 20:48:36.015612 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015557    2554 reconciler.go:26] "Reconciler: start to sync state"
May 20 20:48:36.015832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015793    2554 factory.go:55] Registering systemd factory
May 20 20:48:36.015910 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.015835    2554 factory.go:223] Registration of the systemd container factory successfully
May 20 20:48:36.016015 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.015998    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.016133 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016114    2554 factory.go:153] Registering CRI-O factory
May 20 20:48:36.016133 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016134    2554 factory.go:223] Registration of the crio container factory successfully
May 20 20:48:36.016242 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016185    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 20:48:36.016242 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016214    2554 factory.go:103] Registering Raw factory
May 20 20:48:36.016242 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016233    2554 manager.go:1196] Started watching for new ooms in manager
May 20 20:48:36.016681 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.016663    2554 manager.go:319] Starting recovery of all containers
May 20 20:48:36.019605 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.019574    2554 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 20:48:36.019706 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.019682    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 20:48:36.025339 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.025325    2554 manager.go:324] Recovery completed
May 20 20:48:36.029900 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.029872    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6sdfv"
May 20 20:48:36.031903 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.031889    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.033681 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.033667    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.033771 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.033697    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.033771 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.033712    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.034308 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.034290    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 20:48:36.034308 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.034307    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 20:48:36.034441 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.034326    2554 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:48:36.035564 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.035500    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-50.ec2.internal.18b1611f937258bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-50.ec2.internal,UID:ip-10-0-138-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-50.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-50.ec2.internal,},FirstTimestamp:2026-05-20 20:48:36.033681599 +0000 UTC m=+0.426833419,LastTimestamp:2026-05-20 20:48:36.033681599 +0000 UTC m=+0.426833419,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-50.ec2.internal,}"
May 20 20:48:36.036893 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.036877    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6sdfv"
May 20 20:48:36.037850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.037837    2554 policy_none.go:49] "None policy: Start"
May 20 20:48:36.037920 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.037858    2554 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 20:48:36.037920 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.037872    2554 state_mem.go:35] "Initializing new in-memory state store"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.082693    2554 manager.go:341] "Starting Device Plugin manager"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.082724    2554 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.082734    2554 server.go:85] "Starting device plugin registration server"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.082974    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.082988    2554 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.083100    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.083179    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.083186    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.083719    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 20:48:36.088514 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.083757    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.134965 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.134937    2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 20:48:36.136133 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.136113    2554 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 20:48:36.136244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.136145    2554 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 20:48:36.136244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.136168    2554 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 20:48:36.136244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.136177    2554 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 20:48:36.136244 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.136219    2554 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 20:48:36.138713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.138690    2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:36.183558 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.183486    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.184456 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.184441    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.184529 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.184471    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.184529 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.184482    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.184529 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.184505    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-50.ec2.internal"
May 20 20:48:36.196077 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.196049    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-50.ec2.internal"
May 20 20:48:36.196131 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.196083    2554 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-50.ec2.internal\": node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.215143 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.215125    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.237180 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.237163    2554 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"]
May 20 20:48:36.237247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.237223    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.238165 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.238150    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.238225 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.238173    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.238225 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.238187    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.240557 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.240544    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.240720 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.240707    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.240753 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.240736    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.241315 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241293    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.241382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241320    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.241382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241335    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.241382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241352    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.241382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241368    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.241382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.241381    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.243701 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.243685    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.243790 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.243709    2554 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:36.244395 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.244382    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:36.244461 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.244408    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:36.244461 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.244421    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:36.265712 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.265683    2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-50.ec2.internal\" not found" node="ip-10-0-138-50.ec2.internal"
May 20 20:48:36.270036 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.270021    2554 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-50.ec2.internal\" not found" node="ip-10-0-138-50.ec2.internal"
May 20 20:48:36.315458 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.315433    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.317139 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.317124    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.317193 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.317148    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.317193 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.317168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da7a165be79b358443c245d49aec95fe-config\") pod \"kube-apiserver-proxy-ip-10-0-138-50.ec2.internal\" (UID: \"da7a165be79b358443c245d49aec95fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.416431 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.416395    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.417568 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417550    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.417622 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417580    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.417622 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417598    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da7a165be79b358443c245d49aec95fe-config\") pod \"kube-apiserver-proxy-ip-10-0-138-50.ec2.internal\" (UID: \"da7a165be79b358443c245d49aec95fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.417689 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417651    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.417689 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417653    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0314f0ff3087ba774046c9680337409d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal\" (UID: \"0314f0ff3087ba774046c9680337409d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.417763 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.417709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da7a165be79b358443c245d49aec95fe-config\") pod \"kube-apiserver-proxy-ip-10-0-138-50.ec2.internal\" (UID: \"da7a165be79b358443c245d49aec95fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.517106 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.517046    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.568277 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.568248    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.573045 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.573024    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:36.617877 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.617845    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.718292 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.718257    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.818619 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.818600    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.919080 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:36.919036    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:36.927253 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.927238    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 20:48:36.927372 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:36.927357    2554 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:48:37.015153 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.015109    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 20:48:37.019585 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:37.019561    2554 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-50.ec2.internal\" not found"
May 20 20:48:37.025002 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.024981    2554 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:37.027760 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.027739    2554 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:37.032964 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.032944    2554 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:48:37.038924 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.038890    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 20:43:36 +0000 UTC" deadline="2027-12-11 22:23:25.602396498 +0000 UTC"
May 20 20:48:37.038924 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.038922    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13681h34m48.563477218s"
May 20 20:48:37.090338 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.090272    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8p7h"
May 20 20:48:37.098634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.098614    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8p7h"
May 20 20:48:37.116183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.116157    2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal"
May 20 20:48:37.131168 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:37.131130    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0314f0ff3087ba774046c9680337409d.slice/crio-a9e5ad680025a822701b19c1283b71423841fece3b2a1be949e0b29a66b869fa WatchSource:0}: Error finding container a9e5ad680025a822701b19c1283b71423841fece3b2a1be949e0b29a66b869fa: Status 404 returned error can't find the container with id a9e5ad680025a822701b19c1283b71423841fece3b2a1be949e0b29a66b869fa
May 20 20:48:37.131389 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:37.131371    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7a165be79b358443c245d49aec95fe.slice/crio-0a44d85f8d9d4ce2c50af9221cd0234b31723cf7523874355279d4d8d33c6bf0 WatchSource:0}: Error finding container 0a44d85f8d9d4ce2c50af9221cd0234b31723cf7523874355279d4d8d33c6bf0: Status 404 returned error can't find the container with id 0a44d85f8d9d4ce2c50af9221cd0234b31723cf7523874355279d4d8d33c6bf0
May 20 20:48:37.132509 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.132489    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:48:37.134306 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.134290    2554 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal"
May 20 20:48:37.136153 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.136135    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:48:37.141352 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.141259    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal" event={"ID":"da7a165be79b358443c245d49aec95fe","Type":"ContainerStarted","Data":"0a44d85f8d9d4ce2c50af9221cd0234b31723cf7523874355279d4d8d33c6bf0"}
May 20 20:48:37.142231 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.142213    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal" event={"ID":"0314f0ff3087ba774046c9680337409d","Type":"ContainerStarted","Data":"a9e5ad680025a822701b19c1283b71423841fece3b2a1be949e0b29a66b869fa"}
May 20 20:48:37.144192 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.144175    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:48:37.258335 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.258304    2554 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:37.992416 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:37.992380    2554 apiserver.go:52] "Watching apiserver"
May 20 20:48:38.001720 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.001689    2554 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 20:48:38.003330 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.003304    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-l5wnr","kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh","openshift-dns/node-resolver-zpnzz","openshift-multus/multus-additional-cni-plugins-56w4f","openshift-multus/multus-gr9ww","openshift-network-operator/iptables-alerter-mx5l2","kube-system/global-pull-secret-syncer-cqnn4","kube-system/konnectivity-agent-xzbqs","openshift-cluster-node-tuning-operator/tuned-jjr6f","openshift-image-registry/node-ca-rg7sz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal","openshift-multus/network-metrics-daemon-l6twf","openshift-network-diagnostics/network-check-target-fflpr"]
May 20 20:48:38.008114 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.008077    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.010268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.010248    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.010377 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.010329    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.010541 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.010326    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:38.011311 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.011286    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 20:48:38.011414 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.011319    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 20:48:38.011414 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.011323    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z8szs\""
May 20 20:48:38.012559 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.012539    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:38.012661 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.012640    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:38.013275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.013210    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dnnbd\""
May 20 20:48:38.013275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.013240    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 20:48:38.013423 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.013326    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 20:48:38.013423 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.013372    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 20:48:38.014884 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.014866    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.019110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.017367    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.019110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.017536    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 20:48:38.019110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.018415    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66qdt\""
May 20 20:48:38.019110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.018416    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 20:48:38.019110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.018813    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 20:48:38.019436 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.019272    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 20:48:38.019647 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.019625    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 20:48:38.020461 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.020430    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 20:48:38.020461 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.020438    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4bdh6\""
May 20 20:48:38.020638 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.020484    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.023402 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.023382    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 20:48:38.023498 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.023459    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 20:48:38.023498 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.023468    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7w2b9\""
May 20 20:48:38.024281 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024260    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7h2\" (UniqueName: \"kubernetes.io/projected/ada6c35e-823a-48ae-b194-127f1eb3dda3-kube-api-access-8h7h2\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.024371 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024297    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-registration-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.024371 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024324    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-etc-selinux\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.024371 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024348    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024378    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-conf-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024408    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-multus-daemon-config\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024433    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024456    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-device-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024480    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024499    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-system-cni-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024515    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-cnibin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.024553 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-netns\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-conf\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-sys\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-var-lib-kubelet\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-host\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg44k\" (UniqueName: \"kubernetes.io/projected/37221944-8ed1-464e-b4b1-2b84efbac947-kube-api-access-vg44k\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-binary-copy\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024792    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024819    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-systemd\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024876    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-run\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024890    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-lib-modules\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024927    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.024975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.024972    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-system-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025000    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-os-release\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025014    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025023    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-cni-binary-copy\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-kubelet\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025093    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-modprobe-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025117    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysconfig\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025139    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-kubernetes\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-tmp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-socket-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025215    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-socket-dir-parent\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-bin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-multus\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr6jp\" (UniqueName: \"kubernetes.io/projected/b89fc22b-cfec-4a62-9ce1-3c26063649e0-kube-api-access-qr6jp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025342    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025391    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-sys-fs\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025415    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-os-release\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.025666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025464    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-multus-certs\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-etc-kubernetes\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnjw\" (UniqueName: \"kubernetes.io/projected/02255042-815b-4e26-ba43-fef8bdc21549-kube-api-access-qfnjw\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025552    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025585    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-hostroot\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025616    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-tuned\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-cnibin\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025663    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfm27\" (UniqueName: \"kubernetes.io/projected/6f9e25ca-edda-48fd-a372-0cf38291580c-kube-api-access-cfm27\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.026544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.025687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-k8s-cni-cncf-io\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.027536 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027513    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.027632 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027548    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 20:48:38.027632 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.027591    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:38.027746 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027710    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 20:48:38.027792 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027782    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.027846 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027791    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 20:48:38.028093 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.027934    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d6qd8\""
May 20 20:48:38.030048 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.030029    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.030214 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.030196    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 20:48:38.030571 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.030553    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 20:48:38.030709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.030693    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rwzhj\""
May 20 20:48:38.032203 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.032012    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 20:48:38.032560 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.032525    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.033012 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.032988    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 20:48:38.033115 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033010    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 20:48:38.033115 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033098    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-txvc6\""
May 20 20:48:38.033234 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033215    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 20:48:38.033363 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033295    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 20:48:38.033363 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033335    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 20:48:38.033498 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.033412    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 20:48:38.036171 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.036140    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfp46\""
May 20 20:48:38.036401 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.036380    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 20:48:38.036659 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.036645    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 20:48:38.099496 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.099454    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:43:37 +0000 UTC" deadline="2028-01-31 02:12:37.01531205 +0000 UTC"
May 20 20:48:38.099496 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.099484    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14885h23m58.91583169s"
May 20 20:48:38.116862 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.116837    2554 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 20:48:38.125943 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.125918    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7h2\" (UniqueName: \"kubernetes.io/projected/ada6c35e-823a-48ae-b194-127f1eb3dda3-kube-api-access-8h7h2\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.125953    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-registration-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.125998    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-etc-selinux\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126017    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-multus-daemon-config\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126035    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-systemd-units\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-bin\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126084    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-env-overrides\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.126112 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698bc62b-23ef-4dd6-aa60-13a1105addb5-agent-certs\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126139    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126149    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-registration-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126168    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126195    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-system-cni-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126224    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-cnibin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126251    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-netd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126254    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-system-cni-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126276    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-conf\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126291    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126298    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-host\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126191    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-etc-selinux\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126326    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-cnibin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126348    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg44k\" (UniqueName: \"kubernetes.io/projected/37221944-8ed1-464e-b4b1-2b84efbac947-kube-api-access-vg44k\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126354    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-host\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126405    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.126453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126400    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysctl-conf\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126541    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-system-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126576    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-cni-binary-copy\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126598    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-system-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126607    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-kubelet\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126637    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126664    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-run\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126693    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126703    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-multus-daemon-config\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126721    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-kubelet\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126748    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-hostroot\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126767    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-kubelet\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126777    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-config\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.126790    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126808    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-hostroot\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmnz\" (UniqueName: \"kubernetes.io/projected/b35756ef-24c6-4565-ae5b-36b161302041-kube-api-access-2dmnz\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126850    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysconfig\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126872    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-run\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.126912    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:38.626862436 +0000 UTC m=+3.020014256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126913    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-sysconfig\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126937    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-kubernetes\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126970    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-socket-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.126976    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-kubernetes\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127007    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-socket-dir-parent\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127037    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-multus\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127083    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-multus-certs\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127089    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02255042-815b-4e26-ba43-fef8bdc21549-cni-binary-copy\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127096    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-socket-dir-parent\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127107    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-multus\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127092    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-socket-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127110    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr6jp\" (UniqueName: \"kubernetes.io/projected/b89fc22b-cfec-4a62-9ce1-3c26063649e0-kube-api-access-qr6jp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127146    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-multus-certs\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127170    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127198    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-etc-kubernetes\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.127979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127226    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127223    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnjw\" (UniqueName: \"kubernetes.io/projected/02255042-815b-4e26-ba43-fef8bdc21549-kube-api-access-qfnjw\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127253    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-etc-kubernetes\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127258    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698bc62b-23ef-4dd6-aa60-13a1105addb5-konnectivity-ca\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b35756ef-24c6-4565-ae5b-36b161302041-host\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127348    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127379    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-netns\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127406    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-cnibin\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127441    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-k8s-cni-cncf-io\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127468    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-log-socket\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127478    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-cnibin\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127491    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77ef77fe-e174-42e1-9ff6-0b25936da704-ovn-node-metrics-cert\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127481    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-k8s-cni-cncf-io\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127519    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127552    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-conf-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127579    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-script-lib\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127616    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-device-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.128713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127622    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-conf-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127640    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-netns\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127672    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-bin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127689    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-multus-cni-dir\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127701    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-device-dir\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127726    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-run-netns\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127732    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvvt\" (UniqueName: \"kubernetes.io/projected/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-kube-api-access-ckvvt\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127741    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-host-var-lib-cni-bin\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127758    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-sys\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127782    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-var-lib-kubelet\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127807    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-binary-copy\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127832    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127841    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127858    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-var-lib-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127848    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-sys\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127871    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-var-lib-kubelet\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.129451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127894    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfh5j\" (UniqueName: \"kubernetes.io/projected/77ef77fe-e174-42e1-9ff6-0b25936da704-kube-api-access-tfh5j\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec7ceacc-9434-4760-91b2-bfd8d1968433-hosts-file\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127942    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-systemd\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.127971    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-lib-modules\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128006    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-systemd\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128051    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-os-release\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-systemd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128125    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-lib-modules\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128151    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-modprobe-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128172    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02255042-815b-4e26-ba43-fef8bdc21549-os-release\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128175    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-tmp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128212    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-slash\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128237    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128263    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-iptables-alerter-script\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128268    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-modprobe-d\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128309    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-sys-fs\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128335    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-binary-copy\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.130035 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128334    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-os-release\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128383    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f9e25ca-edda-48fd-a372-0cf38291580c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128395    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-dbus\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128385    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f9e25ca-edda-48fd-a372-0cf38291580c-os-release\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128422    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-etc-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128432    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37221944-8ed1-464e-b4b1-2b84efbac947-sys-fs\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b35756ef-24c6-4565-ae5b-36b161302041-serviceca\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128488    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7ceacc-9434-4760-91b2-bfd8d1968433-tmp-dir\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128490    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128510    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2lh4\" (UniqueName: \"kubernetes.io/projected/ec7ceacc-9434-4760-91b2-bfd8d1968433-kube-api-access-s2lh4\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128524    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-ovn\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128558    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-host-slash\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128589    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-tuned\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128616    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfm27\" (UniqueName: \"kubernetes.io/projected/6f9e25ca-edda-48fd-a372-0cf38291580c-kube-api-access-cfm27\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-kubelet-config\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.130667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.128690    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-node-log\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.131806 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.131784    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-tmp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.131889 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.131837    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b89fc22b-cfec-4a62-9ce1-3c26063649e0-etc-tuned\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.134884 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.134862    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:38.134982 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.134888    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:38.134982 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.134900    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:38.134982 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.134966    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:38.634949513 +0000 UTC m=+3.028101334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:38.137587 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.137282    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7h2\" (UniqueName: \"kubernetes.io/projected/ada6c35e-823a-48ae-b194-127f1eb3dda3-kube-api-access-8h7h2\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.138327 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.137760    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr6jp\" (UniqueName: \"kubernetes.io/projected/b89fc22b-cfec-4a62-9ce1-3c26063649e0-kube-api-access-qr6jp\") pod \"tuned-jjr6f\" (UID: \"b89fc22b-cfec-4a62-9ce1-3c26063649e0\") " pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.138327 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.137772    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg44k\" (UniqueName: \"kubernetes.io/projected/37221944-8ed1-464e-b4b1-2b84efbac947-kube-api-access-vg44k\") pod \"aws-ebs-csi-driver-node-kszvh\" (UID: \"37221944-8ed1-464e-b4b1-2b84efbac947\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.138327 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.138239    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnjw\" (UniqueName: \"kubernetes.io/projected/02255042-815b-4e26-ba43-fef8bdc21549-kube-api-access-qfnjw\") pod \"multus-gr9ww\" (UID: \"02255042-815b-4e26-ba43-fef8bdc21549\") " pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.141344 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.141319    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfm27\" (UniqueName: \"kubernetes.io/projected/6f9e25ca-edda-48fd-a372-0cf38291580c-kube-api-access-cfm27\") pod \"multus-additional-cni-plugins-56w4f\" (UID: \"6f9e25ca-edda-48fd-a372-0cf38291580c\") " pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.228275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.228229    2554 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:38.229426 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229393    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-script-lib\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229547 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229434    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.229547 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229456    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvvt\" (UniqueName: \"kubernetes.io/projected/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-kube-api-access-ckvvt\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.229651 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.229572    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:38.229651 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229591    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-var-lib-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229651 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229626    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfh5j\" (UniqueName: \"kubernetes.io/projected/77ef77fe-e174-42e1-9ff6-0b25936da704-kube-api-access-tfh5j\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229651 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.229643    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:48:38.729621661 +0000 UTC m=+3.122773478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229674    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec7ceacc-9434-4760-91b2-bfd8d1968433-hosts-file\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229706    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-systemd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229734    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-slash\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229760    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229794    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec7ceacc-9434-4760-91b2-bfd8d1968433-hosts-file\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229801    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-systemd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.229835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229811    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-iptables-alerter-script\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229855    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-var-lib-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229861    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-dbus\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229890    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229858    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-slash\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229917    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-dbus\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229895    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-etc-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229937    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-etc-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229962    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.229988    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b35756ef-24c6-4565-ae5b-36b161302041-serviceca\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230016    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7ceacc-9434-4760-91b2-bfd8d1968433-tmp-dir\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230033    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230041    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2lh4\" (UniqueName: \"kubernetes.io/projected/ec7ceacc-9434-4760-91b2-bfd8d1968433-kube-api-access-s2lh4\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230085    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-ovn\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230113    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-host-slash\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.230151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230143    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-kubelet-config\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230169    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-node-log\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230200    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-systemd-units\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230225    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-bin\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230252    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-env-overrides\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230272    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-script-lib\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230282    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698bc62b-23ef-4dd6-aa60-13a1105addb5-agent-certs\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230295    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-host-slash\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230329    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-netd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230337    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/908bc7f1-3f83-473a-85c5-d05a6f45430e-kubelet-config\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230365    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-kubelet\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230369    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-node-log\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230382    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec7ceacc-9434-4760-91b2-bfd8d1968433-tmp-dir\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230423    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-systemd-units\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230442    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-ovn\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230470    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-netd\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230479    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b35756ef-24c6-4565-ae5b-36b161302041-serviceca\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230487    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-kubelet\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.230859 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230503    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-iptables-alerter-script\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230516    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-cni-bin\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230521    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230564    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-config\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230589    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmnz\" (UniqueName: \"kubernetes.io/projected/b35756ef-24c6-4565-ae5b-36b161302041-kube-api-access-2dmnz\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230624    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698bc62b-23ef-4dd6-aa60-13a1105addb5-konnectivity-ca\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230648    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b35756ef-24c6-4565-ae5b-36b161302041-host\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230623    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-run-openvswitch\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230673    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-netns\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230700    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-log-socket\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b35756ef-24c6-4565-ae5b-36b161302041-host\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230803    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77ef77fe-e174-42e1-9ff6-0b25936da704-ovn-node-metrics-cert\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230825    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-log-socket\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230829    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-env-overrides\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.230878    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77ef77fe-e174-42e1-9ff6-0b25936da704-host-run-netns\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.231097    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77ef77fe-e174-42e1-9ff6-0b25936da704-ovnkube-config\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.231709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.231276    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698bc62b-23ef-4dd6-aa60-13a1105addb5-konnectivity-ca\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.233176 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.233151    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77ef77fe-e174-42e1-9ff6-0b25936da704-ovn-node-metrics-cert\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.233281 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.233245    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698bc62b-23ef-4dd6-aa60-13a1105addb5-agent-certs\") pod \"konnectivity-agent-xzbqs\" (UID: \"698bc62b-23ef-4dd6-aa60-13a1105addb5\") " pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.243504 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.243444    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvvt\" (UniqueName: \"kubernetes.io/projected/145fb8c9-ff24-4cf0-aadb-6ce1961596e5-kube-api-access-ckvvt\") pod \"iptables-alerter-mx5l2\" (UID: \"145fb8c9-ff24-4cf0-aadb-6ce1961596e5\") " pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.245554 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.245531    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmnz\" (UniqueName: \"kubernetes.io/projected/b35756ef-24c6-4565-ae5b-36b161302041-kube-api-access-2dmnz\") pod \"node-ca-rg7sz\" (UID: \"b35756ef-24c6-4565-ae5b-36b161302041\") " pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.246430 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.246407    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfh5j\" (UniqueName: \"kubernetes.io/projected/77ef77fe-e174-42e1-9ff6-0b25936da704-kube-api-access-tfh5j\") pod \"ovnkube-node-l5wnr\" (UID: \"77ef77fe-e174-42e1-9ff6-0b25936da704\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.249117 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.249096    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2lh4\" (UniqueName: \"kubernetes.io/projected/ec7ceacc-9434-4760-91b2-bfd8d1968433-kube-api-access-s2lh4\") pod \"node-resolver-zpnzz\" (UID: \"ec7ceacc-9434-4760-91b2-bfd8d1968433\") " pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.320209 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.320167    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjr6f"
May 20 20:48:38.326039 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.326017    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89fc22b_cfec_4a62_9ce1_3c26063649e0.slice/crio-fa548f3d07210b10e49ef2de04d8ad6abec60b39f321da7ffadb5443164ddb8b WatchSource:0}: Error finding container fa548f3d07210b10e49ef2de04d8ad6abec60b39f321da7ffadb5443164ddb8b: Status 404 returned error can't find the container with id fa548f3d07210b10e49ef2de04d8ad6abec60b39f321da7ffadb5443164ddb8b
May 20 20:48:38.326155 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.326114    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh"
May 20 20:48:38.332134 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.332110    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37221944_8ed1_464e_b4b1_2b84efbac947.slice/crio-5952a3f46a69a324039a88a0bd979ace7bb7abacf01db4373bd98a5fd3160b83 WatchSource:0}: Error finding container 5952a3f46a69a324039a88a0bd979ace7bb7abacf01db4373bd98a5fd3160b83: Status 404 returned error can't find the container with id 5952a3f46a69a324039a88a0bd979ace7bb7abacf01db4373bd98a5fd3160b83
May 20 20:48:38.337276 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.337259    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56w4f"
May 20 20:48:38.342796 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.342775    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gr9ww"
May 20 20:48:38.343613 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.343594    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9e25ca_edda_48fd_a372_0cf38291580c.slice/crio-243580884ea9238b6a5d93a6417b3363410efb52cc1a66639b6172739520a169 WatchSource:0}: Error finding container 243580884ea9238b6a5d93a6417b3363410efb52cc1a66639b6172739520a169: Status 404 returned error can't find the container with id 243580884ea9238b6a5d93a6417b3363410efb52cc1a66639b6172739520a169
May 20 20:48:38.348904 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.348883    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:38.350714 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.350692    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02255042_815b_4e26_ba43_fef8bdc21549.slice/crio-b8e0b9d06a393ed77cfcfca72df329915d47814461ce6ec47428811458242018 WatchSource:0}: Error finding container b8e0b9d06a393ed77cfcfca72df329915d47814461ce6ec47428811458242018: Status 404 returned error can't find the container with id b8e0b9d06a393ed77cfcfca72df329915d47814461ce6ec47428811458242018
May 20 20:48:38.355619 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.355550    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698bc62b_23ef_4dd6_aa60_13a1105addb5.slice/crio-b60182099b22b0e2c5a028c3a462bcdc9c59c894b512fc8d5a0de4a2418dcc30 WatchSource:0}: Error finding container b60182099b22b0e2c5a028c3a462bcdc9c59c894b512fc8d5a0de4a2418dcc30: Status 404 returned error can't find the container with id b60182099b22b0e2c5a028c3a462bcdc9c59c894b512fc8d5a0de4a2418dcc30
May 20 20:48:38.355809 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.355797    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mx5l2"
May 20 20:48:38.363079 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.363050    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:48:38.363293 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.363272    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145fb8c9_ff24_4cf0_aadb_6ce1961596e5.slice/crio-17b2f7be90ecf93ccf6c43147d5369c950df15de13a676770ef0c08a716144be WatchSource:0}: Error finding container 17b2f7be90ecf93ccf6c43147d5369c950df15de13a676770ef0c08a716144be: Status 404 returned error can't find the container with id 17b2f7be90ecf93ccf6c43147d5369c950df15de13a676770ef0c08a716144be
May 20 20:48:38.369158 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.369124    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ef77fe_e174_42e1_9ff6_0b25936da704.slice/crio-9420ae929bb7565b20e7266b4f79dfce4078d7b55774d1c0ff7fad3ae8ab0736 WatchSource:0}: Error finding container 9420ae929bb7565b20e7266b4f79dfce4078d7b55774d1c0ff7fad3ae8ab0736: Status 404 returned error can't find the container with id 9420ae929bb7565b20e7266b4f79dfce4078d7b55774d1c0ff7fad3ae8ab0736
May 20 20:48:38.371917 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.371895    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rg7sz"
May 20 20:48:38.377789 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.377771    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpnzz"
May 20 20:48:38.378255 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.378116    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35756ef_24c6_4565_ae5b_36b161302041.slice/crio-f8b3d89ea13a9a3f186d338a105916a46395c534787c3115a9389d8364b565e3 WatchSource:0}: Error finding container f8b3d89ea13a9a3f186d338a105916a46395c534787c3115a9389d8364b565e3: Status 404 returned error can't find the container with id f8b3d89ea13a9a3f186d338a105916a46395c534787c3115a9389d8364b565e3
May 20 20:48:38.383501 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:48:38.383479    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7ceacc_9434_4760_91b2_bfd8d1968433.slice/crio-70c450995d5134656f43f9f3322f0810c1ee9060c618bf457d01f2daebae33b8 WatchSource:0}: Error finding container 70c450995d5134656f43f9f3322f0810c1ee9060c618bf457d01f2daebae33b8: Status 404 returned error can't find the container with id 70c450995d5134656f43f9f3322f0810c1ee9060c618bf457d01f2daebae33b8
May 20 20:48:38.633386 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.633353    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:38.633509 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.633497    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:38.633586 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.633560    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:39.633541467 +0000 UTC m=+4.026693281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:38.733986 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.733792    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:38.733986 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.733983    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:38.734224 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.734018    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:38.734224 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:38.734022    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:38.734224 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.734035    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:38.734224 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.734127    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:39.734101841 +0000 UTC m=+4.127253641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:38.734224 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.734178    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:38.734469 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:38.734239    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:48:39.734221358 +0000 UTC m=+4.127373175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:39.100640 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.100596    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:43:37 +0000 UTC" deadline="2028-01-24 10:15:42.416918025 +0000 UTC"
May 20 20:48:39.100640 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.100637    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14725h27m3.316285073s"
May 20 20:48:39.146896 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.137171    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:39.146896 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.137300    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:39.149612 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.149578    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mx5l2" event={"ID":"145fb8c9-ff24-4cf0-aadb-6ce1961596e5","Type":"ContainerStarted","Data":"17b2f7be90ecf93ccf6c43147d5369c950df15de13a676770ef0c08a716144be"}
May 20 20:48:39.156952 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.155333    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzbqs" event={"ID":"698bc62b-23ef-4dd6-aa60-13a1105addb5","Type":"ContainerStarted","Data":"b60182099b22b0e2c5a028c3a462bcdc9c59c894b512fc8d5a0de4a2418dcc30"}
May 20 20:48:39.157434 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.157406    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gr9ww" event={"ID":"02255042-815b-4e26-ba43-fef8bdc21549","Type":"ContainerStarted","Data":"b8e0b9d06a393ed77cfcfca72df329915d47814461ce6ec47428811458242018"}
May 20 20:48:39.160352 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.160325    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh" event={"ID":"37221944-8ed1-464e-b4b1-2b84efbac947","Type":"ContainerStarted","Data":"5952a3f46a69a324039a88a0bd979ace7bb7abacf01db4373bd98a5fd3160b83"}
May 20 20:48:39.163723 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.163690    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjr6f" event={"ID":"b89fc22b-cfec-4a62-9ce1-3c26063649e0","Type":"ContainerStarted","Data":"fa548f3d07210b10e49ef2de04d8ad6abec60b39f321da7ffadb5443164ddb8b"}
May 20 20:48:39.165907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.165859    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rg7sz" event={"ID":"b35756ef-24c6-4565-ae5b-36b161302041","Type":"ContainerStarted","Data":"f8b3d89ea13a9a3f186d338a105916a46395c534787c3115a9389d8364b565e3"}
May 20 20:48:39.168019 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.167975    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"9420ae929bb7565b20e7266b4f79dfce4078d7b55774d1c0ff7fad3ae8ab0736"}
May 20 20:48:39.173514 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.173460    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerStarted","Data":"243580884ea9238b6a5d93a6417b3363410efb52cc1a66639b6172739520a169"}
May 20 20:48:39.192686 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.192647    2554 generic.go:358] "Generic (PLEG): container finished" podID="0314f0ff3087ba774046c9680337409d" containerID="c9248adedb2c6aedcfbe47bf75e6dc4012f38b40ce51fc76f3a30e94558f7a19" exitCode=0
May 20 20:48:39.192827 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.192733    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal" event={"ID":"0314f0ff3087ba774046c9680337409d","Type":"ContainerDied","Data":"c9248adedb2c6aedcfbe47bf75e6dc4012f38b40ce51fc76f3a30e94558f7a19"}
May 20 20:48:39.200712 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.200680    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpnzz" event={"ID":"ec7ceacc-9434-4760-91b2-bfd8d1968433","Type":"ContainerStarted","Data":"70c450995d5134656f43f9f3322f0810c1ee9060c618bf457d01f2daebae33b8"}
May 20 20:48:39.642280 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.642157    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:39.642280 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.642298    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:39.642623 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.642361    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:41.642342625 +0000 UTC m=+6.035494425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:39.743320 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.743284    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:39.743504 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:39.743364    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:39.743561 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.743509    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:39.743610 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.743573    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:48:41.743555401 +0000 UTC m=+6.136707215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:39.744010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.743987    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:39.744010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.744008    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:39.744198 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.744021    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:39.744198 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:39.744079    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:41.744050563 +0000 UTC m=+6.137202363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:40.137292 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:40.137260    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:40.137753 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:40.137426    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:40.140291 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:40.140267    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:40.140416 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:40.140390    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:40.212140 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:40.212100    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal" event={"ID":"0314f0ff3087ba774046c9680337409d","Type":"ContainerStarted","Data":"e225b54fa3ebf1e936e826d148fc7ed75deeb096b367d3f4b0badf6917adcb07"}
May 20 20:48:40.221698 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:40.221667    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal" event={"ID":"da7a165be79b358443c245d49aec95fe","Type":"ContainerStarted","Data":"f77d3fa1f778a4c68ccfa6b4d6d34ab2417c176ccdaae93fa32bccc317210c06"}
May 20 20:48:40.247074 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:40.246915    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-50.ec2.internal" podStartSLOduration=3.246895767 podStartE2EDuration="3.246895767s" podCreationTimestamp="2026-05-20 20:48:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:48:40.228907222 +0000 UTC m=+4.622059047" watchObservedRunningTime="2026-05-20 20:48:40.246895767 +0000 UTC m=+4.640047591"
May 20 20:48:41.137417 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:41.136902    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:41.137417 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.137033    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:41.660352 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:41.660315    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:41.660535 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.660482    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:41.660592 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.660563    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:45.660540701 +0000 UTC m=+10.053692519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:41.761856 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:41.761678    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:41.761856 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:41.761769    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:41.761856 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.761844    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:41.762110 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.761920    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:48:45.761899947 +0000 UTC m=+10.155051760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:41.762110 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.761928    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:41.762110 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.761949    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:41.762110 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.761963    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:41.762110 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:41.762013    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:45.761996969 +0000 UTC m=+10.155148769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:42.137691 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:42.137191    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:42.137691 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:42.137337    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:42.138424 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:42.138285    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:42.138424 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:42.138386    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:43.136510 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:43.136474    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:43.136687 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:43.136605    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:44.137095 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:44.136768    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:44.137095 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:44.136768    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:44.137095 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:44.136930    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:44.137095 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:44.136988    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:45.136474 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:45.136436    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:45.136637 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.136571    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:45.698723 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:45.698176    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:45.698723 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.698338    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:45.698723 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.698403    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:53.698384608 +0000 UTC m=+18.091536413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:45.799025    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:45.799134    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799292    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799312    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799329    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799394    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:53.799374112 +0000 UTC m=+18.192525914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799773    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:45.799846 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:45.799821    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:48:53.799806377 +0000 UTC m=+18.192958181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:46.137096 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:46.136585    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:46.138232 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:46.137696    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:46.138232 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:46.138091    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:46.138232 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:46.138186    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:47.136535 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:47.136493    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:47.137011 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:47.136631    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:48.137258 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:48.137217    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:48.137690 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:48.137229    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:48.137690 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:48.137346    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:48.137690 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:48.137461    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:49.137262 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:49.137233    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:49.137698 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:49.137346    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:50.136903 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:50.136864    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:50.137109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:50.136868    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:50.137109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:50.137008    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:50.137109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:50.137094    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:51.137263 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:51.137223    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:51.137745 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:51.137350    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:52.137002 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:52.136971    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:52.137143 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:52.136972    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:52.137143 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:52.137120    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:52.137247 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:52.137197    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:53.136567 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:53.136534    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:53.136991 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.136664    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:53.757714 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:53.757673    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:53.757874 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.757813    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:53.757926 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.757895    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:09.757873905 +0000 UTC m=+34.151025721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:53.858782 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:53.858743    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:53.859010 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:53.858815    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:53.859010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.858951    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:53.859010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.858983    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:53.859010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.858959    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:48:53.859010 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.858998    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:53.859250 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.859055    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:09.859037339 +0000 UTC m=+34.252189156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:53.859250 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:53.859090    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:49:09.859080261 +0000 UTC m=+34.252232062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:48:54.136640 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:54.136606    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:54.137114 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:54.136606    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:54.137114 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:54.136725    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:54.137114 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:54.136818    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:55.137032 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:55.137000    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:55.137447 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:55.137128    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:56.137209 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:56.137177    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:56.137706 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:56.137283    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:56.137706 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:56.137353    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:56.137706 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:56.137452    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:57.136756 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.136526    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:57.136883 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:57.136861    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:57.251036 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.251001    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"bdd7cc6efabb01657b0581956a10add91ef5143ea33d0e784ef3a96d8e1957e7"}
May 20 20:48:57.252408 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.252378    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="d8f41fe1493abf15606a3f546653b054ce3f130693abef452dde217513d333a6" exitCode=0
May 20 20:48:57.252538 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.252461    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"d8f41fe1493abf15606a3f546653b054ce3f130693abef452dde217513d333a6"}
May 20 20:48:57.253946 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.253919    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpnzz" event={"ID":"ec7ceacc-9434-4760-91b2-bfd8d1968433","Type":"ContainerStarted","Data":"a97a6347f35f6acb2c78380f5c15be604f7ed0f443832fe9b9ed7371b5297533"}
May 20 20:48:57.255589 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.255565    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzbqs" event={"ID":"698bc62b-23ef-4dd6-aa60-13a1105addb5","Type":"ContainerStarted","Data":"ad0a865b6ba5b2b223f7ce201791a341907b54a4444a1fb883dcc1e530eae593"}
May 20 20:48:57.257030 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.257010    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gr9ww" event={"ID":"02255042-815b-4e26-ba43-fef8bdc21549","Type":"ContainerStarted","Data":"1c6ec8c2b021348b0402e7fc69b615d2d5c9e011a6de97451cd16d31f0e99a98"}
May 20 20:48:57.258545 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.258524    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh" event={"ID":"37221944-8ed1-464e-b4b1-2b84efbac947","Type":"ContainerStarted","Data":"31f61b8b480e97b46dca678847c78850155a6ace9e3a9e07b74a363ad98fb38f"}
May 20 20:48:57.260527 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.260508    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjr6f" event={"ID":"b89fc22b-cfec-4a62-9ce1-3c26063649e0","Type":"ContainerStarted","Data":"a6177e0400835e2ca753c154f1f32e595243d2a43d85e481052716e44a190a95"}
May 20 20:48:57.261846 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.261822    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rg7sz" event={"ID":"b35756ef-24c6-4565-ae5b-36b161302041","Type":"ContainerStarted","Data":"c3d1a13ab550052ad215b92072c50d3633897b510498683c496713abbfe58a18"}
May 20 20:48:57.274707 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.274667    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-50.ec2.internal" podStartSLOduration=20.274653922 podStartE2EDuration="20.274653922s" podCreationTimestamp="2026-05-20 20:48:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:48:40.248021932 +0000 UTC m=+4.641173755" watchObservedRunningTime="2026-05-20 20:48:57.274653922 +0000 UTC m=+21.667805743"
May 20 20:48:57.290129 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.290086    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rg7sz" podStartSLOduration=3.001109169 podStartE2EDuration="21.290054148s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.380414124 +0000 UTC m=+2.773565924" lastFinishedPulling="2026-05-20 20:48:56.669359088 +0000 UTC m=+21.062510903" observedRunningTime="2026-05-20 20:48:57.289871852 +0000 UTC m=+21.683023674" watchObservedRunningTime="2026-05-20 20:48:57.290054148 +0000 UTC m=+21.683205971"
May 20 20:48:57.304165 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.304120    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jjr6f" podStartSLOduration=2.947628179 podStartE2EDuration="21.304107158s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.327625742 +0000 UTC m=+2.720777542" lastFinishedPulling="2026-05-20 20:48:56.684104707 +0000 UTC m=+21.077256521" observedRunningTime="2026-05-20 20:48:57.303892461 +0000 UTC m=+21.697044282" watchObservedRunningTime="2026-05-20 20:48:57.304107158 +0000 UTC m=+21.697258980"
May 20 20:48:57.319236 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.319192    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zpnzz" podStartSLOduration=2.034946605 podStartE2EDuration="20.319178997s" podCreationTimestamp="2026-05-20 20:48:37 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.385130323 +0000 UTC m=+2.778282124" lastFinishedPulling="2026-05-20 20:48:56.6693627 +0000 UTC m=+21.062514516" observedRunningTime="2026-05-20 20:48:57.318778085 +0000 UTC m=+21.711929910" watchObservedRunningTime="2026-05-20 20:48:57.319178997 +0000 UTC m=+21.712330818"
May 20 20:48:57.338307 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.338251    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gr9ww" podStartSLOduration=2.989746864 podStartE2EDuration="21.338232496s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.353833608 +0000 UTC m=+2.746985409" lastFinishedPulling="2026-05-20 20:48:56.702319241 +0000 UTC m=+21.095471041" observedRunningTime="2026-05-20 20:48:57.338093798 +0000 UTC m=+21.731245614" watchObservedRunningTime="2026-05-20 20:48:57.338232496 +0000 UTC m=+21.731384319"
May 20 20:48:57.362188 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:57.362113    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzbqs" podStartSLOduration=7.611991884 podStartE2EDuration="21.362099752s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.360229964 +0000 UTC m=+2.753381764" lastFinishedPulling="2026-05-20 20:48:52.110337833 +0000 UTC m=+16.503489632" observedRunningTime="2026-05-20 20:48:57.361534053 +0000 UTC m=+21.754685878" watchObservedRunningTime="2026-05-20 20:48:57.362099752 +0000 UTC m=+21.755251574"
May 20 20:48:58.137079 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.136768    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:48:58.137240 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:58.137143    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:48:58.137353 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.137329    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:48:58.137486 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:58.137435    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:48:58.140124 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.140091    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 20:48:58.264834 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.264753    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mx5l2" event={"ID":"145fb8c9-ff24-4cf0-aadb-6ce1961596e5","Type":"ContainerStarted","Data":"d51093c23001924d130e14a08c6d2a683aded18355d5e656846442065daec48e"}
May 20 20:48:58.266671 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.266646    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh" event={"ID":"37221944-8ed1-464e-b4b1-2b84efbac947","Type":"ContainerStarted","Data":"be9fbd69aeb48ad6e5d47a26fc4e02626938104d3b0818a3a82f9a0105ae17a4"}
May 20 20:48:58.269330 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269309    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:48:58.269711 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269691    2554 generic.go:358] "Generic (PLEG): container finished" podID="77ef77fe-e174-42e1-9ff6-0b25936da704" containerID="ba3c4b1a9bf499dc05b29be7adbf472100c1329bc783bd4aca1fb032e042bb58" exitCode=1
May 20 20:48:58.269894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269828    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"a4b1ff20d3e0d4e6a45016756af41f04730ae8bfe7500583bb2c0ffa3394cb0d"}
May 20 20:48:58.269894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269862    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"ca69829c659d35f1a0468013dfcfa6b9030b8776c9aa816196885eb74c10c9ca"}
May 20 20:48:58.269894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269878    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"61c64fdb15a3df42477c4911bfdc7afe3bd5cc702bb63ec79e74983d22c0c294"}
May 20 20:48:58.269894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269890    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"33d076246c5c3018846dfe0da341504a87e24a73939b4093c23e358a559cb4e0"}
May 20 20:48:58.270215 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.269903    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerDied","Data":"ba3c4b1a9bf499dc05b29be7adbf472100c1329bc783bd4aca1fb032e042bb58"}
May 20 20:48:58.280006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:58.279953    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mx5l2" podStartSLOduration=3.962597857 podStartE2EDuration="22.279935s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.36580789 +0000 UTC m=+2.758959699" lastFinishedPulling="2026-05-20 20:48:56.68314504 +0000 UTC m=+21.076296842" observedRunningTime="2026-05-20 20:48:58.279553982 +0000 UTC m=+22.672705804" watchObservedRunningTime="2026-05-20 20:48:58.279935 +0000 UTC m=+22.673086824"
May 20 20:48:59.098159 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.098030    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T20:48:58.140105331Z","UUID":"2ec9ff90-cf37-4843-aa9e-ef6ac5a50060","Handler":null,"Name":"","Endpoint":""}
May 20 20:48:59.099884 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.099861    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 20:48:59.099884 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.099890    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 20:48:59.137315 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.137283    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:48:59.137488 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:48:59.137427    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:48:59.362089 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.361984    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:48:59.362646 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:48:59.362626    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:49:00.137438 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.137100    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:00.137438 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.137126    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:00.137438 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:00.137241    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:00.137438 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:00.137355    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:00.279830 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.279740    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh" event={"ID":"37221944-8ed1-464e-b4b1-2b84efbac947","Type":"ContainerStarted","Data":"b434503de7921e18e027c6e00f36ff99a472c8d635ef6df7da145aaea1df9d95"}
May 20 20:49:00.283029 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.283010    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:49:00.283490 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.283462    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"92f49cca1e2aaaa93e4d13f3d9d6fdc7df5e9460511237660d8d931dafc51e5d"}
May 20 20:49:00.283668 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.283649    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:49:00.284143 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.284124    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzbqs"
May 20 20:49:00.312702 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:00.312646    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kszvh" podStartSLOduration=3.440821512 podStartE2EDuration="24.312630667s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.333883925 +0000 UTC m=+2.727035726" lastFinishedPulling="2026-05-20 20:48:59.205693078 +0000 UTC m=+23.598844881" observedRunningTime="2026-05-20 20:49:00.31248534 +0000 UTC m=+24.705637163" watchObservedRunningTime="2026-05-20 20:49:00.312630667 +0000 UTC m=+24.705782489"
May 20 20:49:01.136601 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:01.136569    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:01.136944 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:01.136705    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:02.137323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:02.137284    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:02.137323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:02.137325    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:02.137820 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:02.137448    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:02.137820 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:02.137575    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:02.294525 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:02.294498    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:49:02.296584 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:02.296557    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="dc8939fb38d1a4e35b3eb68655f83b254e0baa52353f533f2a7427c4917a1e8f" exitCode=0
May 20 20:49:02.296716 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:02.296644    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"dc8939fb38d1a4e35b3eb68655f83b254e0baa52353f533f2a7427c4917a1e8f"}
May 20 20:49:03.137389 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.137217    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:03.137942 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:03.137465    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:03.301672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.301646    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:49:03.301976 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.301956    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"0bb78a4c685ddb9ab6cf366d085a896682efe14f6356eb998f3ad88899e5ef97"}
May 20 20:49:03.302286 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.302271    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:03.302286 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.302289    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:03.302468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.302452    2554 scope.go:117] "RemoveContainer" containerID="ba3c4b1a9bf499dc05b29be7adbf472100c1329bc783bd4aca1fb032e042bb58"
May 20 20:49:03.303942 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.303907    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="be2308d4c2c518c17640006117c36dabadaaa5b1f48e4b96872d927c49f541ac" exitCode=0
May 20 20:49:03.304023 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.303968    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"be2308d4c2c518c17640006117c36dabadaaa5b1f48e4b96872d927c49f541ac"}
May 20 20:49:03.319415 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:03.319395    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:04.137313 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.137232    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:04.137442 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:04.137356    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:04.137758 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.137523    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:04.137758 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:04.137614    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:04.309101 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.309053    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:49:04.309404 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.309382    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" event={"ID":"77ef77fe-e174-42e1-9ff6-0b25936da704","Type":"ContainerStarted","Data":"f27d3ecb31b0c6c3b7d93b6829202b106cd31acbf9386df9d02922b837fc3689"}
May 20 20:49:04.309591 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.309576    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:04.311969 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.311940    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="3d7f225e2c4d02c0ed2ace4c47df28cb0a012fc3a2e3df2eaf402523df3e0add" exitCode=0
May 20 20:49:04.312083 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.312004    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"3d7f225e2c4d02c0ed2ace4c47df28cb0a012fc3a2e3df2eaf402523df3e0add"}
May 20 20:49:04.325414 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.325392    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:04.341776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.341734    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr" podStartSLOduration=9.580297563 podStartE2EDuration="28.34172186s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.370372613 +0000 UTC m=+2.763524413" lastFinishedPulling="2026-05-20 20:48:57.13179691 +0000 UTC m=+21.524948710" observedRunningTime="2026-05-20 20:49:04.340089112 +0000 UTC m=+28.733240928" watchObservedRunningTime="2026-05-20 20:49:04.34172186 +0000 UTC m=+28.734873682"
May 20 20:49:04.476022 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.475942    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fflpr"]
May 20 20:49:04.476163 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.476058    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:04.476203 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:04.476171    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:04.478657 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.478620    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6twf"]
May 20 20:49:04.478792 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.478724    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:04.478870 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:04.478829    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:04.479282 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.479263    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqnn4"]
May 20 20:49:04.479342 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:04.479328    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:04.479441 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:04.479416    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:06.137688 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:06.137655    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:06.138168 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:06.137754    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:06.138168 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:06.137787    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:06.138168 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:06.137802    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:06.138168 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:06.137858    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:06.138168 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:06.137908    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:08.137570 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:08.137373    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:08.138015 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:08.137373    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:08.138015 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:08.137415    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:08.138015 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:08.137700    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:08.138015 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:08.137935    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:08.138222 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:08.138045    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:09.775753 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:09.775718    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:09.776312 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.775898    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:09.776312 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.775981    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:41.775958428 +0000 UTC m=+66.169110247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:09.876437 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:09.876407    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:09.876621 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:09.876475    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:09.876621 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876577    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:49:09.876621 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876599    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:49:09.876621 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876621    2554 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:49:09.876811 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876634    2554 projected.go:194] Error preparing data for projected volume kube-api-access-ntzwp for pod openshift-network-diagnostics/network-check-target-fflpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:09.876811 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876639    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret podName:908bc7f1-3f83-473a-85c5-d05a6f45430e nodeName:}" failed. No retries permitted until 2026-05-20 20:49:41.876621814 +0000 UTC m=+66.269773616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret") pod "global-pull-secret-syncer-cqnn4" (UID: "908bc7f1-3f83-473a-85c5-d05a6f45430e") : object "kube-system"/"original-pull-secret" not registered
May 20 20:49:09.876811 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:09.876681    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp podName:5d7d4d1d-b5e6-414c-b97c-beea0f526544 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:41.876663583 +0000 UTC m=+66.269815384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntzwp" (UniqueName: "kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp") pod "network-check-target-fflpr" (UID: "5d7d4d1d-b5e6-414c-b97c-beea0f526544") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:10.136985 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:10.136946    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:10.137185 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:10.136946    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:10.137185 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:10.137102    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflpr" podUID="5d7d4d1d-b5e6-414c-b97c-beea0f526544"
May 20 20:49:10.137307 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:10.137208    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:49:10.137307 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:10.136950    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:10.137411 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:10.137340    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqnn4" podUID="908bc7f1-3f83-473a-85c5-d05a6f45430e"
May 20 20:49:10.973962 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:10.973933    2554 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-50.ec2.internal" event="NodeReady"
May 20 20:49:10.974526 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:10.974120    2554 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 20:49:11.031869 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.031832    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4mhkn"]
May 20 20:49:11.063593 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.063562    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j97vz"]
May 20 20:49:11.063765 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.063733    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.066461 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.066437    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2cd4\""
May 20 20:49:11.067094 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.067046    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 20:49:11.067094 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.067048    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 20:49:11.078882 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.078862    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4mhkn"]
May 20 20:49:11.078970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.078889    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j97vz"]
May 20 20:49:11.079010 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.078980    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.081876 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.081853    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 20:49:11.082360 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.082339    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 20:49:11.082463 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.082418    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5vsdg\""
May 20 20:49:11.082716 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.082697    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 20:49:11.185932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.185895    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09013d-3827-4be6-885a-8edf54feb99a-tmp-dir\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.186103 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.185950    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c09013d-3827-4be6-885a-8edf54feb99a-config-volume\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.186103 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.186085    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5trj8\" (UniqueName: \"kubernetes.io/projected/1c09013d-3827-4be6-885a-8edf54feb99a-kube-api-access-5trj8\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.186189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.186110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.186189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.186128    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjhx\" (UniqueName: \"kubernetes.io/projected/bd5309f4-2558-42c7-9107-acd0d3b08205-kube-api-access-4gjhx\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.186189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.186155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287165    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.287244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287203    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjhx\" (UniqueName: \"kubernetes.io/projected/bd5309f4-2558-42c7-9107-acd0d3b08205-kube-api-access-4gjhx\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.287244 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287221    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287286    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09013d-3827-4be6-885a-8edf54feb99a-tmp-dir\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.287315    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287340    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c09013d-3827-4be6-885a-8edf54feb99a-config-volume\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.287363    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:11.787347333 +0000 UTC m=+36.180499134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287423    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5trj8\" (UniqueName: \"kubernetes.io/projected/1c09013d-3827-4be6-885a-8edf54feb99a-kube-api-access-5trj8\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287494 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.287480    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:11.287726 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.287537    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:11.787519865 +0000 UTC m=+36.180671686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:11.287783 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287765    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c09013d-3827-4be6-885a-8edf54feb99a-tmp-dir\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.287934 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.287918    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c09013d-3827-4be6-885a-8edf54feb99a-config-volume\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.300680 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.300654    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5trj8\" (UniqueName: \"kubernetes.io/projected/1c09013d-3827-4be6-885a-8edf54feb99a-kube-api-access-5trj8\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.300798 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.300774    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjhx\" (UniqueName: \"kubernetes.io/projected/bd5309f4-2558-42c7-9107-acd0d3b08205-kube-api-access-4gjhx\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.791247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.791211    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:11.791362 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:11.791255    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:11.791407 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.791367    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:11.791447 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.791438    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:11.791491 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.791449    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:12.791428713 +0000 UTC m=+37.184580526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:11.791491 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:11.791470    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:12.791460378 +0000 UTC m=+37.184612178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:12.136697 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.136616    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:12.136697 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.136635    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:12.137428 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.136616    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:12.140875 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140834    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:49:12.140875 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140839    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 20:49:12.141106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140891    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:49:12.141106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140909    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7l2g\""
May 20 20:49:12.141106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140960    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:49:12.141106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.140971    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q28sq\""
May 20 20:49:12.331188 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.331154    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="45e80b9f1180851ff4cd9357fc91b69b6ff4a85295bcaae62ff8b94d45497060" exitCode=0
May 20 20:49:12.331188 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.331189    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"45e80b9f1180851ff4cd9357fc91b69b6ff4a85295bcaae62ff8b94d45497060"}
May 20 20:49:12.799541 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.799449    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:12.799541 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:12.799491    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:12.799758 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:12.799616    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:12.799758 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:12.799621    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:12.799758 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:12.799684    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:14.799665744 +0000 UTC m=+39.192817543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:12.799758 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:12.799703    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:14.799694745 +0000 UTC m=+39.192846545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:13.336009 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:13.335972    2554 generic.go:358] "Generic (PLEG): container finished" podID="6f9e25ca-edda-48fd-a372-0cf38291580c" containerID="1cd301496868b4807083b617921da959c703326ac330a0dfc320409fc723baa7" exitCode=0
May 20 20:49:13.336009 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:13.336002    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerDied","Data":"1cd301496868b4807083b617921da959c703326ac330a0dfc320409fc723baa7"}
May 20 20:49:14.341056 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:14.340835    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56w4f" event={"ID":"6f9e25ca-edda-48fd-a372-0cf38291580c","Type":"ContainerStarted","Data":"267762e6ca69a99b3b1f0cb00c39a56419a40ee59327c291777b6c213c833575"}
May 20 20:49:14.365445 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:14.365397    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-56w4f" podStartSLOduration=5.1371282560000004 podStartE2EDuration="38.365381547s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:48:38.347484649 +0000 UTC m=+2.740636462" lastFinishedPulling="2026-05-20 20:49:11.575737934 +0000 UTC m=+35.968889753" observedRunningTime="2026-05-20 20:49:14.363632369 +0000 UTC m=+38.756784192" watchObservedRunningTime="2026-05-20 20:49:14.365381547 +0000 UTC m=+38.758533369"
May 20 20:49:14.816394 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:14.816361    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:14.816551 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:14.816407    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:14.816551 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:14.816525    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:14.816670 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:14.816572    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:14.816670 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:14.816594    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:18.816578045 +0000 UTC m=+43.209729845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:14.816670 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:14.816634    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:18.816618061 +0000 UTC m=+43.209769879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:18.844679 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:18.844644    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:18.844679 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:18.844684    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:18.845109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:18.844788    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:18.845109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:18.844795    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:18.845109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:18.844842    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:26.844828623 +0000 UTC m=+51.237980423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:18.845109 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:18.844875    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:26.844868831 +0000 UTC m=+51.238020630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:26.899088 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:26.899029    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:26.899088 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:26.899086    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:26.899620 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:26.899190    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:26.899620 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:26.899248    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:26.899620 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:26.899255    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:42.899237408 +0000 UTC m=+67.292389216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:26.899620 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:26.899285    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:49:42.899274134 +0000 UTC m=+67.292425948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:36.327081 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:36.327017    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5wnr"
May 20 20:49:41.802657 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.802619    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:49:41.805903 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.805884    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:49:41.813289 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:41.813272    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:49:41.813358 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:41.813334    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:50:45.813316801 +0000 UTC m=+130.206468601 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : secret "metrics-daemon-secret" not found
May 20 20:49:41.903965 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.903927    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:41.904131 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.904106    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:41.907048 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.907033    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:49:41.907165 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.907149    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 20:49:41.917310 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.917295    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:49:41.917392 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.917351    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/908bc7f1-3f83-473a-85c5-d05a6f45430e-original-pull-secret\") pod \"global-pull-secret-syncer-cqnn4\" (UID: \"908bc7f1-3f83-473a-85c5-d05a6f45430e\") " pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:41.927090 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:41.927054    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntzwp\" (UniqueName: \"kubernetes.io/projected/5d7d4d1d-b5e6-414c-b97c-beea0f526544-kube-api-access-ntzwp\") pod \"network-check-target-fflpr\" (UID: \"5d7d4d1d-b5e6-414c-b97c-beea0f526544\") " pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:42.152276 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.152205    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqnn4"
May 20 20:49:42.159961 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.159918    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7l2g\""
May 20 20:49:42.167282 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.167259    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:42.352200 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.352098    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqnn4"]
May 20 20:49:42.354833 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.354804    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fflpr"]
May 20 20:49:42.355042 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:49:42.355020    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908bc7f1_3f83_473a_85c5_d05a6f45430e.slice/crio-f3ad8c8150d751541c978b9dee7798d653412a3524320dcdeb3b9aa6087e7192 WatchSource:0}: Error finding container f3ad8c8150d751541c978b9dee7798d653412a3524320dcdeb3b9aa6087e7192: Status 404 returned error can't find the container with id f3ad8c8150d751541c978b9dee7798d653412a3524320dcdeb3b9aa6087e7192
May 20 20:49:42.357342 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:49:42.357322    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7d4d1d_b5e6_414c_b97c_beea0f526544.slice/crio-48da897a80cedf7cf24def44e506a94658dd4424dc874f0a6937a460fee7939a WatchSource:0}: Error finding container 48da897a80cedf7cf24def44e506a94658dd4424dc874f0a6937a460fee7939a: Status 404 returned error can't find the container with id 48da897a80cedf7cf24def44e506a94658dd4424dc874f0a6937a460fee7939a
May 20 20:49:42.393215 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.393175    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fflpr" event={"ID":"5d7d4d1d-b5e6-414c-b97c-beea0f526544","Type":"ContainerStarted","Data":"48da897a80cedf7cf24def44e506a94658dd4424dc874f0a6937a460fee7939a"}
May 20 20:49:42.394150 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.394125    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqnn4" event={"ID":"908bc7f1-3f83-473a-85c5-d05a6f45430e","Type":"ContainerStarted","Data":"f3ad8c8150d751541c978b9dee7798d653412a3524320dcdeb3b9aa6087e7192"}
May 20 20:49:42.910976 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.910910    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:49:42.910976 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:42.910949    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:49:42.911623 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:42.911089    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:42.911623 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:42.911091    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:42.911623 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:42.911177    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:50:14.911156081 +0000 UTC m=+99.304307900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:49:42.911623 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:49:42.911253    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:50:14.911233296 +0000 UTC m=+99.304385104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:49:47.405393 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:47.405351    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fflpr" event={"ID":"5d7d4d1d-b5e6-414c-b97c-beea0f526544","Type":"ContainerStarted","Data":"a7a8f69dd81e5153ca9b91ecaca548c3bdd728cd690073c4d71ca971fe97b355"}
May 20 20:49:47.405826 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:47.405571    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:49:47.406564 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:47.406541    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqnn4" event={"ID":"908bc7f1-3f83-473a-85c5-d05a6f45430e","Type":"ContainerStarted","Data":"574ebeba7fba3e8bdd6b5cb1216e2aeeccda2bbdd105b237b095bf518dd1c1e4"}
May 20 20:49:47.425109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:47.425047    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fflpr" podStartSLOduration=67.193331463 podStartE2EDuration="1m11.425033822s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:49:42.359237366 +0000 UTC m=+66.752389179" lastFinishedPulling="2026-05-20 20:49:46.590939722 +0000 UTC m=+70.984091538" observedRunningTime="2026-05-20 20:49:47.424826105 +0000 UTC m=+71.817977939" watchObservedRunningTime="2026-05-20 20:49:47.425033822 +0000 UTC m=+71.818185644"
May 20 20:49:47.447037 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:49:47.446992    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cqnn4" podStartSLOduration=67.209462962 podStartE2EDuration="1m11.44698091s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:49:42.356759128 +0000 UTC m=+66.749910928" lastFinishedPulling="2026-05-20 20:49:46.594277073 +0000 UTC m=+70.987428876" observedRunningTime="2026-05-20 20:49:47.446870397 +0000 UTC m=+71.840022230" watchObservedRunningTime="2026-05-20 20:49:47.44698091 +0000 UTC m=+71.840132732"
May 20 20:50:14.928532 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:14.928496    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:50:14.928532 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:14.928539    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:50:14.928979 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:14.928658    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:50:14.928979 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:14.928727    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls podName:1c09013d-3827-4be6-885a-8edf54feb99a nodeName:}" failed. No retries permitted until 2026-05-20 20:51:18.928707293 +0000 UTC m=+163.321859106 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls") pod "dns-default-4mhkn" (UID: "1c09013d-3827-4be6-885a-8edf54feb99a") : secret "dns-default-metrics-tls" not found
May 20 20:50:14.928979 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:14.928736    2554 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:50:14.928979 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:14.928795    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert podName:bd5309f4-2558-42c7-9107-acd0d3b08205 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:18.928783113 +0000 UTC m=+163.321934913 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert") pod "ingress-canary-j97vz" (UID: "bd5309f4-2558-42c7-9107-acd0d3b08205") : secret "canary-serving-cert" not found
May 20 20:50:18.411490 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:18.411461    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fflpr"
May 20 20:50:45.843424 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:45.843385    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:50:45.843895 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:45.843531    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:50:45.843895 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:45.843598    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs podName:ada6c35e-823a-48ae-b194-127f1eb3dda3 nodeName:}" failed. No retries permitted until 2026-05-20 20:52:47.843581664 +0000 UTC m=+252.236733465 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs") pod "network-metrics-daemon-l6twf" (UID: "ada6c35e-823a-48ae-b194-127f1eb3dda3") : secret "metrics-daemon-secret" not found
May 20 20:50:53.140546 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.140506    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"]
May 20 20:50:53.142322 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.142305    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-tvq8c"]
May 20 20:50:53.142467 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.142448    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"
May 20 20:50:53.143879 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.143860    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:50:53.144028 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.143980    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.145758 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.145742    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"]
May 20 20:50:53.145878 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.145863    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.147372 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147348    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 20 20:50:53.147477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147399    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 20 20:50:53.147477 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147432    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4jf5p\""
May 20 20:50:53.147583 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147522    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2xsns\""
May 20 20:50:53.147731 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147714    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 20 20:50:53.147796 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147746    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 20 20:50:53.147849 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.147820    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 20 20:50:53.148108 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.148080    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 20 20:50:53.148200 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.148136    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.148604 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.148337    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 20:50:53.149604 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.149583    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 20:50:53.149791 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.149769    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcs9r\""
May 20 20:50:53.149962 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.149946    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 20:50:53.152652 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.152630    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 20 20:50:53.152746 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.152690    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mgkhz\""
May 20 20:50:53.153830 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.153812    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 20 20:50:53.153970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.153949    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 20 20:50:53.154699 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.154683    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 20 20:50:53.157194 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.157167    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"]
May 20 20:50:53.159518 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.159477    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 20 20:50:53.160561 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.160546    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-tvq8c"]
May 20 20:50:53.160842 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.160826    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 20:50:53.161638 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.161620    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"]
May 20 20:50:53.173147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.173126    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:50:53.230212 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.230180    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"]
May 20 20:50:53.232264 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.232246    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.235760 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.235731    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 20:50:53.235760 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.235750    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 20:50:53.236246 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.236231    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 20:50:53.237243 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.237224    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 20:50:53.237243 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.237225    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7tc9v\""
May 20 20:50:53.242243 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.242220    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"]
May 20 20:50:53.294700 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294668    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4fl\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.294700 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294699    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft5w8\" (UniqueName: \"kubernetes.io/projected/8a6ba428-9f03-412d-8813-b31775e6a0c3-kube-api-access-ft5w8\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.294907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.294907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294759    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84h4\" (UniqueName: \"kubernetes.io/projected/1626ba63-0db1-4f37-a387-616f6d72b61d-kube-api-access-g84h4\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.294907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294829    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.294907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294866    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbjg\" (UniqueName: \"kubernetes.io/projected/1f04c240-9f3b-4099-a6ab-cf38685b6a75-kube-api-access-bwbjg\") pod \"volume-data-source-validator-5cf8c89d64-z4lwg\" (UID: \"1f04c240-9f3b-4099-a6ab-cf38685b6a75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"
May 20 20:50:53.294907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294893    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.294977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295013    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1626ba63-0db1-4f37-a387-616f6d72b61d-serving-cert\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295044    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a6ba428-9f03-412d-8813-b31775e6a0c3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-trusted-ca\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295125    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8zk\" (UniqueName: \"kubernetes.io/projected/3bad82d2-518b-4383-bec6-5e83738b143b-kube-api-access-fg8zk\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295144    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bad82d2-518b-4383-bec6-5e83738b143b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.295172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-config\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.295447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295207    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.295447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.295447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295260    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.295447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.295280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a6ba428-9f03-412d-8813-b31775e6a0c3-config\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.396155 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396045    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396155 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396104    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396155 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396124    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396155 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396140    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a6ba428-9f03-412d-8813-b31775e6a0c3-config\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396160    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4fl\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396177    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft5w8\" (UniqueName: \"kubernetes.io/projected/8a6ba428-9f03-412d-8813-b31775e6a0c3-kube-api-access-ft5w8\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396201    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.396295    2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.396324    2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ddf5b7478-467g5: secret "image-registry-tls" not found
May 20 20:50:53.396471 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.396397    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls podName:e8a906ef-00c4-437b-ae6d-ac820db8885f nodeName:}" failed. No retries permitted until 2026-05-20 20:50:53.896372183 +0000 UTC m=+138.289523998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls") pod "image-registry-ddf5b7478-467g5" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f") : secret "image-registry-tls" not found
May 20 20:50:53.396752 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396538    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g84h4\" (UniqueName: \"kubernetes.io/projected/1626ba63-0db1-4f37-a387-616f6d72b61d-kube-api-access-g84h4\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.396752 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396586    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396752 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396630    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbjg\" (UniqueName: \"kubernetes.io/projected/1f04c240-9f3b-4099-a6ab-cf38685b6a75-kube-api-access-bwbjg\") pod \"volume-data-source-validator-5cf8c89d64-z4lwg\" (UID: \"1f04c240-9f3b-4099-a6ab-cf38685b6a75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"
May 20 20:50:53.396752 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396672    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.396752 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396714    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396754    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396789    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1626ba63-0db1-4f37-a387-616f6d72b61d-serving-cert\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396829    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a6ba428-9f03-412d-8813-b31775e6a0c3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396859    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-trusted-ca\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396884    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a6ba428-9f03-412d-8813-b31775e6a0c3-config\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396903    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8zk\" (UniqueName: \"kubernetes.io/projected/3bad82d2-518b-4383-bec6-5e83738b143b-kube-api-access-fg8zk\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396952    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bad82d2-518b-4383-bec6-5e83738b143b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396965    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.396990 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.396987    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-config\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.397466 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.397013    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.397466 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.397121    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:50:53.397466 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.397191    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:50:53.897174792 +0000 UTC m=+138.290326596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:50:53.397731 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.397700    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.397812 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.397773    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-config\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.397869 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.397803    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bad82d2-518b-4383-bec6-5e83738b143b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.398524 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.398504    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1626ba63-0db1-4f37-a387-616f6d72b61d-trusted-ca\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.399699 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.399681    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1626ba63-0db1-4f37-a387-616f6d72b61d-serving-cert\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.399699 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.399693    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a6ba428-9f03-412d-8813-b31775e6a0c3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.399826 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.399774    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.399894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.399872    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.407457 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.407431    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbjg\" (UniqueName: \"kubernetes.io/projected/1f04c240-9f3b-4099-a6ab-cf38685b6a75-kube-api-access-bwbjg\") pod \"volume-data-source-validator-5cf8c89d64-z4lwg\" (UID: \"1f04c240-9f3b-4099-a6ab-cf38685b6a75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"
May 20 20:50:53.407594 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.407555    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft5w8\" (UniqueName: \"kubernetes.io/projected/8a6ba428-9f03-412d-8813-b31775e6a0c3-kube-api-access-ft5w8\") pod \"kube-storage-version-migrator-operator-565644f49-j6grc\" (UID: \"8a6ba428-9f03-412d-8813-b31775e6a0c3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.407666 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.407592    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8zk\" (UniqueName: \"kubernetes.io/projected/3bad82d2-518b-4383-bec6-5e83738b143b-kube-api-access-fg8zk\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.408116 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.408094    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.408600 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.408582    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84h4\" (UniqueName: \"kubernetes.io/projected/1626ba63-0db1-4f37-a387-616f6d72b61d-kube-api-access-g84h4\") pod \"console-operator-76dff48d59-tvq8c\" (UID: \"1626ba63-0db1-4f37-a387-616f6d72b61d\") " pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.409022 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.409006    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4fl\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.455166 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.455139    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"
May 20 20:50:53.464231 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.463883    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:50:53.473862 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.473804    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"
May 20 20:50:53.598850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.598792    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg"]
May 20 20:50:53.602410 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:50:53.602383    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f04c240_9f3b_4099_a6ab_cf38685b6a75.slice/crio-2f0cb78dfc998a610ba28a0c9d94f50dbad26be39f491f1cf0be2d93914127e2 WatchSource:0}: Error finding container 2f0cb78dfc998a610ba28a0c9d94f50dbad26be39f491f1cf0be2d93914127e2: Status 404 returned error can't find the container with id 2f0cb78dfc998a610ba28a0c9d94f50dbad26be39f491f1cf0be2d93914127e2
May 20 20:50:53.821861 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.821831    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-tvq8c"]
May 20 20:50:53.824098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.824077    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc"]
May 20 20:50:53.825560 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:50:53.825522    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1626ba63_0db1_4f37_a387_616f6d72b61d.slice/crio-882d2a2c4b0c3455f1e9431ed82fbce8adf00b619612b7282835c3d63c9f399d WatchSource:0}: Error finding container 882d2a2c4b0c3455f1e9431ed82fbce8adf00b619612b7282835c3d63c9f399d: Status 404 returned error can't find the container with id 882d2a2c4b0c3455f1e9431ed82fbce8adf00b619612b7282835c3d63c9f399d
May 20 20:50:53.826622 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:50:53.826600    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6ba428_9f03_412d_8813_b31775e6a0c3.slice/crio-f8d6eb5285109a67f3f160475270b6fdcac630351da5c31869cd3a9a248b354d WatchSource:0}: Error finding container f8d6eb5285109a67f3f160475270b6fdcac630351da5c31869cd3a9a248b354d: Status 404 returned error can't find the container with id f8d6eb5285109a67f3f160475270b6fdcac630351da5c31869cd3a9a248b354d
May 20 20:50:53.900813 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.900774    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:53.900969 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:53.900848    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:53.900969 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.900928    2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:50:53.900969 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.900943    2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ddf5b7478-467g5: secret "image-registry-tls" not found
May 20 20:50:53.901107 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.900994    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls podName:e8a906ef-00c4-437b-ae6d-ac820db8885f nodeName:}" failed. No retries permitted until 2026-05-20 20:50:54.900980699 +0000 UTC m=+139.294132499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls") pod "image-registry-ddf5b7478-467g5" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f") : secret "image-registry-tls" not found
May 20 20:50:53.901107 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.900926    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:50:53.901107 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:53.901088    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:50:54.901055969 +0000 UTC m=+139.294207768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:50:54.537836 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:54.537797    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc" event={"ID":"8a6ba428-9f03-412d-8813-b31775e6a0c3","Type":"ContainerStarted","Data":"f8d6eb5285109a67f3f160475270b6fdcac630351da5c31869cd3a9a248b354d"}
May 20 20:50:54.539484 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:54.539432    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg" event={"ID":"1f04c240-9f3b-4099-a6ab-cf38685b6a75","Type":"ContainerStarted","Data":"2f0cb78dfc998a610ba28a0c9d94f50dbad26be39f491f1cf0be2d93914127e2"}
May 20 20:50:54.541324 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:54.541267    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" event={"ID":"1626ba63-0db1-4f37-a387-616f6d72b61d","Type":"ContainerStarted","Data":"882d2a2c4b0c3455f1e9431ed82fbce8adf00b619612b7282835c3d63c9f399d"}
May 20 20:50:54.907758 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:54.907714    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:54.907950 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:54.907808    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:54.908013 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:54.907958    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:50:54.908094 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:54.908022    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:50:56.908002459 +0000 UTC m=+141.301154263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:50:54.908167 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:54.908105    2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:50:54.908167 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:54.908116    2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ddf5b7478-467g5: secret "image-registry-tls" not found
May 20 20:50:54.908167 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:54.908153    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls podName:e8a906ef-00c4-437b-ae6d-ac820db8885f nodeName:}" failed. No retries permitted until 2026-05-20 20:50:56.908141321 +0000 UTC m=+141.301293124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls") pod "image-registry-ddf5b7478-467g5" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f") : secret "image-registry-tls" not found
May 20 20:50:55.183290 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.183207    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"]
May 20 20:50:55.185268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.185247    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"
May 20 20:50:55.188600 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.188580    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-phlzf\""
May 20 20:50:55.194495 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.194463    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"]
May 20 20:50:55.312273 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.312238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psqmb\" (UniqueName: \"kubernetes.io/projected/186a4a96-6206-4579-b489-2669b08012ea-kube-api-access-psqmb\") pod \"network-check-source-7f44b6dd87-q2qmd\" (UID: \"186a4a96-6206-4579-b489-2669b08012ea\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"
May 20 20:50:55.413687 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.413641    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psqmb\" (UniqueName: \"kubernetes.io/projected/186a4a96-6206-4579-b489-2669b08012ea-kube-api-access-psqmb\") pod \"network-check-source-7f44b6dd87-q2qmd\" (UID: \"186a4a96-6206-4579-b489-2669b08012ea\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"
May 20 20:50:55.424435 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.424404    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psqmb\" (UniqueName: \"kubernetes.io/projected/186a4a96-6206-4579-b489-2669b08012ea-kube-api-access-psqmb\") pod \"network-check-source-7f44b6dd87-q2qmd\" (UID: \"186a4a96-6206-4579-b489-2669b08012ea\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"
May 20 20:50:55.494832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:55.494746    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"
May 20 20:50:56.337759 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.337729    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd"]
May 20 20:50:56.342615 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.342584    2554 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1626ba63_0db1_4f37_a387_616f6d72b61d.slice/crio-conmon-9475e129ce10f005ff3c78815966936a3f752d5a58acaf08295dcc1b6dd00c03.scope\": RecentStats: unable to find data in memory cache]"
May 20 20:50:56.370220 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:50:56.370174    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186a4a96_6206_4579_b489_2669b08012ea.slice/crio-c839ac99831931e280c45f87e4096884119dbd89e84d500db4b33be2597edf8d WatchSource:0}: Error finding container c839ac99831931e280c45f87e4096884119dbd89e84d500db4b33be2597edf8d: Status 404 returned error can't find the container with id c839ac99831931e280c45f87e4096884119dbd89e84d500db4b33be2597edf8d
May 20 20:50:56.548270 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.548239    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/0.log"
May 20 20:50:56.548428 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.548277    2554 generic.go:358] "Generic (PLEG): container finished" podID="1626ba63-0db1-4f37-a387-616f6d72b61d" containerID="9475e129ce10f005ff3c78815966936a3f752d5a58acaf08295dcc1b6dd00c03" exitCode=255
May 20 20:50:56.548428 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.548349    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" event={"ID":"1626ba63-0db1-4f37-a387-616f6d72b61d","Type":"ContainerDied","Data":"9475e129ce10f005ff3c78815966936a3f752d5a58acaf08295dcc1b6dd00c03"}
May 20 20:50:56.548648 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.548622    2554 scope.go:117] "RemoveContainer" containerID="9475e129ce10f005ff3c78815966936a3f752d5a58acaf08295dcc1b6dd00c03"
May 20 20:50:56.549770 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.549746    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc" event={"ID":"8a6ba428-9f03-412d-8813-b31775e6a0c3","Type":"ContainerStarted","Data":"c77b192cf86d621794479ef3677577112dd81c1494ff99131ecd083828c6c211"}
May 20 20:50:56.551114 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.551077    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg" event={"ID":"1f04c240-9f3b-4099-a6ab-cf38685b6a75","Type":"ContainerStarted","Data":"f64b55c579bc16861e5fc0b3dcdfcfcf052327cee79276be94b15d1c14255f65"}
May 20 20:50:56.552391 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.552344    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd" event={"ID":"186a4a96-6206-4579-b489-2669b08012ea","Type":"ContainerStarted","Data":"4d01d7536f18c6c46a937fb678ba1cc88c210b0cbbb4451da8d983ab52c6f238"}
May 20 20:50:56.552481 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.552397    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd" event={"ID":"186a4a96-6206-4579-b489-2669b08012ea","Type":"ContainerStarted","Data":"c839ac99831931e280c45f87e4096884119dbd89e84d500db4b33be2597edf8d"}
May 20 20:50:56.587805 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.587753    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q2qmd" podStartSLOduration=1.5877352930000002 podStartE2EDuration="1.587735293s" podCreationTimestamp="2026-05-20 20:50:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:50:56.587568531 +0000 UTC m=+140.980720355" watchObservedRunningTime="2026-05-20 20:50:56.587735293 +0000 UTC m=+140.980887120"
May 20 20:50:56.606090 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.605920    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc" podStartSLOduration=1.237650095 podStartE2EDuration="3.605900934s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:50:53.831445526 +0000 UTC m=+138.224597330" lastFinishedPulling="2026-05-20 20:50:56.19969636 +0000 UTC m=+140.592848169" observedRunningTime="2026-05-20 20:50:56.605517734 +0000 UTC m=+140.998669556" watchObservedRunningTime="2026-05-20 20:50:56.605900934 +0000 UTC m=+140.999052759"
May 20 20:50:56.626751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.626695    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z4lwg" podStartSLOduration=1.039809661 podStartE2EDuration="3.626677801s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:50:53.604005607 +0000 UTC m=+137.997157407" lastFinishedPulling="2026-05-20 20:50:56.190873734 +0000 UTC m=+140.584025547" observedRunningTime="2026-05-20 20:50:56.625652385 +0000 UTC m=+141.018804209" watchObservedRunningTime="2026-05-20 20:50:56.626677801 +0000 UTC m=+141.019829624"
May 20 20:50:56.928544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.928441    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:50:56.928544 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:56.928541    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:50:56.928762 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.928608    2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:50:56.928762 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.928633    2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ddf5b7478-467g5: secret "image-registry-tls" not found
May 20 20:50:56.928762 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.928677    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:50:56.928762 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.928705    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls podName:e8a906ef-00c4-437b-ae6d-ac820db8885f nodeName:}" failed. No retries permitted until 2026-05-20 20:51:00.928685514 +0000 UTC m=+145.321837328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls") pod "image-registry-ddf5b7478-467g5" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f") : secret "image-registry-tls" not found
May 20 20:50:56.928762 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:56.928725    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:51:00.928713094 +0000 UTC m=+145.321864894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:50:57.556614 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.556582    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:50:57.557102 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.557026    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/0.log"
May 20 20:50:57.557102 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.557089    2554 generic.go:358] "Generic (PLEG): container finished" podID="1626ba63-0db1-4f37-a387-616f6d72b61d" containerID="458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d" exitCode=255
May 20 20:50:57.557234 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.557205    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" event={"ID":"1626ba63-0db1-4f37-a387-616f6d72b61d","Type":"ContainerDied","Data":"458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d"}
May 20 20:50:57.557278 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.557263    2554 scope.go:117] "RemoveContainer" containerID="9475e129ce10f005ff3c78815966936a3f752d5a58acaf08295dcc1b6dd00c03"
May 20 20:50:57.557504 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:57.557484    2554 scope.go:117] "RemoveContainer" containerID="458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d"
May 20 20:50:57.557729 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:57.557692    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-tvq8c_openshift-console-operator(1626ba63-0db1-4f37-a387-616f6d72b61d)\"" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" podUID="1626ba63-0db1-4f37-a387-616f6d72b61d"
May 20 20:50:58.561405 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:58.561376    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:50:58.561760 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:58.561731    2554 scope.go:117] "RemoveContainer" containerID="458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d"
May 20 20:50:58.561904 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:50:58.561887    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-tvq8c_openshift-console-operator(1626ba63-0db1-4f37-a387-616f6d72b61d)\"" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" podUID="1626ba63-0db1-4f37-a387-616f6d72b61d"
May 20 20:50:59.726457 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:50:59.726433    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpnzz_ec7ceacc-9434-4760-91b2-bfd8d1968433/dns-node-resolver/0.log"
May 20 20:51:00.527195 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:00.527168    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rg7sz_b35756ef-24c6-4565-ae5b-36b161302041/node-ca/0.log"
May 20 20:51:00.967247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:00.967197    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:00.967288    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:00.967356    2554 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:00.967373    2554 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-ddf5b7478-467g5: secret "image-registry-tls" not found
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:00.967393    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:00.967438    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls podName:e8a906ef-00c4-437b-ae6d-ac820db8885f nodeName:}" failed. No retries permitted until 2026-05-20 20:51:08.967419461 +0000 UTC m=+153.360571276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls") pod "image-registry-ddf5b7478-467g5" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f") : secret "image-registry-tls" not found
May 20 20:51:00.967633 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:00.967454    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:51:08.967447561 +0000 UTC m=+153.360599361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:51:03.465048 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:03.464998    2554 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:51:03.465048 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:03.465054    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:51:03.465490 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:03.465446    2554 scope.go:117] "RemoveContainer" containerID="458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d"
May 20 20:51:03.465625 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:03.465607    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-tvq8c_openshift-console-operator(1626ba63-0db1-4f37-a387-616f6d72b61d)\"" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" podUID="1626ba63-0db1-4f37-a387-616f6d72b61d"
May 20 20:51:09.029936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.029859    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:51:09.030353 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.029979    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:09.030353 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:09.029996    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:51:09.030353 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:09.030060    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls podName:3bad82d2-518b-4383-bec6-5e83738b143b nodeName:}" failed. No retries permitted until 2026-05-20 20:51:25.03004351 +0000 UTC m=+169.423195309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-ppcnl" (UID: "3bad82d2-518b-4383-bec6-5e83738b143b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:51:09.032273 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.032255    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"image-registry-ddf5b7478-467g5\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") " pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:09.069541 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.069501    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:09.198676 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.198605    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:51:09.201386 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:09.201359    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a906ef_00c4_437b_ae6d_ac820db8885f.slice/crio-8ba075e36d4dccec821547e33821d11b7a97654d704b88e278a8cf537a42d8d5 WatchSource:0}: Error finding container 8ba075e36d4dccec821547e33821d11b7a97654d704b88e278a8cf537a42d8d5: Status 404 returned error can't find the container with id 8ba075e36d4dccec821547e33821d11b7a97654d704b88e278a8cf537a42d8d5
May 20 20:51:09.588562 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.588524    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" event={"ID":"e8a906ef-00c4-437b-ae6d-ac820db8885f","Type":"ContainerStarted","Data":"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"}
May 20 20:51:09.588562 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.588564    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" event={"ID":"e8a906ef-00c4-437b-ae6d-ac820db8885f","Type":"ContainerStarted","Data":"8ba075e36d4dccec821547e33821d11b7a97654d704b88e278a8cf537a42d8d5"}
May 20 20:51:09.588775 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.588685    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:09.614571 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:09.614513    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" podStartSLOduration=16.614498035 podStartE2EDuration="16.614498035s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:09.613946344 +0000 UTC m=+154.007098170" watchObservedRunningTime="2026-05-20 20:51:09.614498035 +0000 UTC m=+154.007649857"
May 20 20:51:14.074835 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:14.074789    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4mhkn" podUID="1c09013d-3827-4be6-885a-8edf54feb99a"
May 20 20:51:14.088981 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:14.088950    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j97vz" podUID="bd5309f4-2558-42c7-9107-acd0d3b08205"
May 20 20:51:14.601377 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:14.601341    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:15.146523 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:15.146486    2554 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l6twf" podUID="ada6c35e-823a-48ae-b194-127f1eb3dda3"
May 20 20:51:18.136907 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.136865    2554 scope.go:117] "RemoveContainer" containerID="458e14159b2a796d44c8a13840d35abf009d714691284db537e43772d937df2d"
May 20 20:51:18.611881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.611856    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:51:18.612106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.611914    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" event={"ID":"1626ba63-0db1-4f37-a387-616f6d72b61d","Type":"ContainerStarted","Data":"d1cec22955774724f6688300e6e496f722b99673195424b798e614984e8d4d07"}
May 20 20:51:18.612220 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.612194    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:51:18.633558 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.633505    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c" podStartSLOduration=23.265116486 podStartE2EDuration="25.633492247s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:50:53.82752037 +0000 UTC m=+138.220672170" lastFinishedPulling="2026-05-20 20:50:56.195896132 +0000 UTC m=+140.589047931" observedRunningTime="2026-05-20 20:51:18.632940617 +0000 UTC m=+163.026092438" watchObservedRunningTime="2026-05-20 20:51:18.633492247 +0000 UTC m=+163.026644070"
May 20 20:51:18.978665 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:18.978580    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-tvq8c"
May 20 20:51:19.002777 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.002746    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:51:19.002777 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.002782    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:19.005481 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.005458    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c09013d-3827-4be6-885a-8edf54feb99a-metrics-tls\") pod \"dns-default-4mhkn\" (UID: \"1c09013d-3827-4be6-885a-8edf54feb99a\") " pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:19.005733 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.005708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5309f4-2558-42c7-9107-acd0d3b08205-cert\") pod \"ingress-canary-j97vz\" (UID: \"bd5309f4-2558-42c7-9107-acd0d3b08205\") " pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:51:19.105994 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.105961    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2cd4\""
May 20 20:51:19.113171 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.113146    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:19.246019 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.245917    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4mhkn"]
May 20 20:51:19.250611 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:19.250583    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c09013d_3827_4be6_885a_8edf54feb99a.slice/crio-5681b2487b1a43ccdf0c8013c246ec91253d24b7aebb007a168a5f90b80ba3e6 WatchSource:0}: Error finding container 5681b2487b1a43ccdf0c8013c246ec91253d24b7aebb007a168a5f90b80ba3e6: Status 404 returned error can't find the container with id 5681b2487b1a43ccdf0c8013c246ec91253d24b7aebb007a168a5f90b80ba3e6
May 20 20:51:19.616235 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:19.616194    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4mhkn" event={"ID":"1c09013d-3827-4be6-885a-8edf54feb99a","Type":"ContainerStarted","Data":"5681b2487b1a43ccdf0c8013c246ec91253d24b7aebb007a168a5f90b80ba3e6"}
May 20 20:51:21.623521 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:21.623486    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4mhkn" event={"ID":"1c09013d-3827-4be6-885a-8edf54feb99a","Type":"ContainerStarted","Data":"3f067ccd74d44f664364d6b394c62e6220823df776cb786011877c2530a000e6"}
May 20 20:51:21.623521 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:21.623519    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4mhkn" event={"ID":"1c09013d-3827-4be6-885a-8edf54feb99a","Type":"ContainerStarted","Data":"c46f04455c864d10473672d3312ed4721fe5f999dd33987b683ed1cb360f3618"}
May 20 20:51:21.624190 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:21.624169    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:21.644396 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:21.644350    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4mhkn" podStartSLOduration=129.105444056 podStartE2EDuration="2m10.6443362s" podCreationTimestamp="2026-05-20 20:49:11 +0000 UTC" firstStartedPulling="2026-05-20 20:51:19.25252992 +0000 UTC m=+163.645681719" lastFinishedPulling="2026-05-20 20:51:20.791422051 +0000 UTC m=+165.184573863" observedRunningTime="2026-05-20 20:51:21.643730124 +0000 UTC m=+166.036881947" watchObservedRunningTime="2026-05-20 20:51:21.6443362 +0000 UTC m=+166.037488063"
May 20 20:51:22.595766 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.595734    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:51:22.603382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.603352    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hmh86"]
May 20 20:51:22.605360 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.605339    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.608411 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.608387    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 20:51:22.608784 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.608768    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 20:51:22.608856 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.608790    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 20:51:22.608911 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.608880    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7g46\""
May 20 20:51:22.610905 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.610890    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 20:51:22.620554 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.620531    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-jjgfq"]
May 20 20:51:22.622302 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.622283    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:22.623501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.623480    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmh86"]
May 20 20:51:22.624943 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.624923    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g2fkq\""
May 20 20:51:22.625273 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.624970    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 20:51:22.626049 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.626028    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 20:51:22.630988 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.630967    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/776416a8-cce7-4e89-8e1f-90f23694b48f-data-volume\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.631093 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.631043    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/776416a8-cce7-4e89-8e1f-90f23694b48f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.631153 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.631134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/776416a8-cce7-4e89-8e1f-90f23694b48f-crio-socket\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.631203 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.631187    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.631257 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.631231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgpk\" (UniqueName: \"kubernetes.io/projected/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-api-access-vxgpk\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.636368 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.636345    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-jjgfq"]
May 20 20:51:22.638759 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.638739    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5fd8d896-zkfrr"]
May 20 20:51:22.640720 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.640698    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.654104 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.654061    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5fd8d896-zkfrr"]
May 20 20:51:22.731528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731492    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-registry-certificates\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.731528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731534    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731579    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgpk\" (UniqueName: \"kubernetes.io/projected/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-api-access-vxgpk\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-bound-sa-token\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731629    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/776416a8-cce7-4e89-8e1f-90f23694b48f-data-volume\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1036e916-de14-492c-9f00-2af0e63c0446-ca-trust-extracted\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731671    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86v28\" (UniqueName: \"kubernetes.io/projected/5afb596b-3dbf-4692-a146-4d30c2987e74-kube-api-access-86v28\") pod \"downloads-57bd96b888-jjgfq\" (UID: \"5afb596b-3dbf-4692-a146-4d30c2987e74\") " pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:22.731776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-trusted-ca\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-registry-tls\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731891    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/776416a8-cce7-4e89-8e1f-90f23694b48f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731948    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-installation-pull-secrets\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.731986    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttw7\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-kube-api-access-wttw7\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.732001    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/776416a8-cce7-4e89-8e1f-90f23694b48f-data-volume\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.732051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.732024    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/776416a8-cce7-4e89-8e1f-90f23694b48f-crio-socket\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.732275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.732055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-image-registry-private-configuration\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.732275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.732123    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/776416a8-cce7-4e89-8e1f-90f23694b48f-crio-socket\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.732275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.732164    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.734096 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.734059    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/776416a8-cce7-4e89-8e1f-90f23694b48f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.747334 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.747307    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgpk\" (UniqueName: \"kubernetes.io/projected/776416a8-cce7-4e89-8e1f-90f23694b48f-kube-api-access-vxgpk\") pod \"insights-runtime-extractor-hmh86\" (UID: \"776416a8-cce7-4e89-8e1f-90f23694b48f\") " pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.833269 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833236    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1036e916-de14-492c-9f00-2af0e63c0446-ca-trust-extracted\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833269 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833273    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86v28\" (UniqueName: \"kubernetes.io/projected/5afb596b-3dbf-4692-a146-4d30c2987e74-kube-api-access-86v28\") pod \"downloads-57bd96b888-jjgfq\" (UID: \"5afb596b-3dbf-4692-a146-4d30c2987e74\") " pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:22.833513 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833399    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-trusted-ca\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833513 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833431    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-registry-tls\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833513 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833465    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-installation-pull-secrets\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833513 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833500    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wttw7\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-kube-api-access-wttw7\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833531    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-image-registry-private-configuration\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833575    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-registry-certificates\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833636    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-bound-sa-token\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.833713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.833682    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1036e916-de14-492c-9f00-2af0e63c0446-ca-trust-extracted\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.834329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.834308    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-trusted-ca\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.834470 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.834444    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1036e916-de14-492c-9f00-2af0e63c0446-registry-certificates\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.836213 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.836188    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-image-registry-private-configuration\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.836339 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.836273    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-registry-tls\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.836420 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.836398    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1036e916-de14-492c-9f00-2af0e63c0446-installation-pull-secrets\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.842313 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.842294    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttw7\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-kube-api-access-wttw7\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.846688 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.846632    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86v28\" (UniqueName: \"kubernetes.io/projected/5afb596b-3dbf-4692-a146-4d30c2987e74-kube-api-access-86v28\") pod \"downloads-57bd96b888-jjgfq\" (UID: \"5afb596b-3dbf-4692-a146-4d30c2987e74\") " pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:22.847015 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.846999    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1036e916-de14-492c-9f00-2af0e63c0446-bound-sa-token\") pod \"image-registry-6c5fd8d896-zkfrr\" (UID: \"1036e916-de14-492c-9f00-2af0e63c0446\") " pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:22.915002 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.914971    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmh86"
May 20 20:51:22.931771 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.931740    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:22.949911 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:22.949817    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:23.085761 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.085721    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmh86"]
May 20 20:51:23.090382 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:23.090322    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776416a8_cce7_4e89_8e1f_90f23694b48f.slice/crio-5737f126b31b39bdc833b7f897c0b01d651d1ca94c3f0f8443d9b1c8afcd6613 WatchSource:0}: Error finding container 5737f126b31b39bdc833b7f897c0b01d651d1ca94c3f0f8443d9b1c8afcd6613: Status 404 returned error can't find the container with id 5737f126b31b39bdc833b7f897c0b01d651d1ca94c3f0f8443d9b1c8afcd6613
May 20 20:51:23.106813 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.106790    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-jjgfq"]
May 20 20:51:23.123733 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.123483    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5fd8d896-zkfrr"]
May 20 20:51:23.123849 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:23.123779    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afb596b_3dbf_4692_a146_4d30c2987e74.slice/crio-ca17954ffbe8f3fe0fef27308d55ffc04b8275c4a345466e6b01fcfe67384019 WatchSource:0}: Error finding container ca17954ffbe8f3fe0fef27308d55ffc04b8275c4a345466e6b01fcfe67384019: Status 404 returned error can't find the container with id ca17954ffbe8f3fe0fef27308d55ffc04b8275c4a345466e6b01fcfe67384019
May 20 20:51:23.125513 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:23.125490    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1036e916_de14_492c_9f00_2af0e63c0446.slice/crio-b565a19682e3fe637278a08741785e3334bf7f5271595254a59faa81e06fb9d1 WatchSource:0}: Error finding container b565a19682e3fe637278a08741785e3334bf7f5271595254a59faa81e06fb9d1: Status 404 returned error can't find the container with id b565a19682e3fe637278a08741785e3334bf7f5271595254a59faa81e06fb9d1
May 20 20:51:23.631429 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.631346    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr" event={"ID":"1036e916-de14-492c-9f00-2af0e63c0446","Type":"ContainerStarted","Data":"609ae857317bb290397a2ac17e9b16ed011ec5243e0112a9afd74417a27f9de9"}
May 20 20:51:23.631429 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.631397    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr" event={"ID":"1036e916-de14-492c-9f00-2af0e63c0446","Type":"ContainerStarted","Data":"b565a19682e3fe637278a08741785e3334bf7f5271595254a59faa81e06fb9d1"}
May 20 20:51:23.631947 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.631459    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:23.632440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.632416    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-jjgfq" event={"ID":"5afb596b-3dbf-4692-a146-4d30c2987e74","Type":"ContainerStarted","Data":"ca17954ffbe8f3fe0fef27308d55ffc04b8275c4a345466e6b01fcfe67384019"}
May 20 20:51:23.633695 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.633676    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmh86" event={"ID":"776416a8-cce7-4e89-8e1f-90f23694b48f","Type":"ContainerStarted","Data":"e90c16bff5d277e3c9748ba861b4da8a7ed1043e646b0f56f2c1c89ecef31be1"}
May 20 20:51:23.633793 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:23.633697    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmh86" event={"ID":"776416a8-cce7-4e89-8e1f-90f23694b48f","Type":"ContainerStarted","Data":"5737f126b31b39bdc833b7f897c0b01d651d1ca94c3f0f8443d9b1c8afcd6613"}
May 20 20:51:24.638407 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:24.638361    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmh86" event={"ID":"776416a8-cce7-4e89-8e1f-90f23694b48f","Type":"ContainerStarted","Data":"884b9c2b25f924722d83c2da45a5e9cebc61bd933c949dc9e9f209a61d7189af"}
May 20 20:51:25.052719 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.052680    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:51:25.055368 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.055343    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bad82d2-518b-4383-bec6-5e83738b143b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-ppcnl\" (UID: \"3bad82d2-518b-4383-bec6-5e83738b143b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:51:25.341329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.341250    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"
May 20 20:51:25.531145 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.531083    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr" podStartSLOduration=3.531048427 podStartE2EDuration="3.531048427s" podCreationTimestamp="2026-05-20 20:51:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:23.656621957 +0000 UTC m=+168.049773780" watchObservedRunningTime="2026-05-20 20:51:25.531048427 +0000 UTC m=+169.924200249"
May 20 20:51:25.531891 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.531867    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl"]
May 20 20:51:25.534878 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:25.534850    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bad82d2_518b_4383_bec6_5e83738b143b.slice/crio-530f94c84ab8d056306d500f1134af60e3c17c6da460a6c2c846bc6c952124fa WatchSource:0}: Error finding container 530f94c84ab8d056306d500f1134af60e3c17c6da460a6c2c846bc6c952124fa: Status 404 returned error can't find the container with id 530f94c84ab8d056306d500f1134af60e3c17c6da460a6c2c846bc6c952124fa
May 20 20:51:25.642264 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.642173    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl" event={"ID":"3bad82d2-518b-4383-bec6-5e83738b143b","Type":"ContainerStarted","Data":"530f94c84ab8d056306d500f1134af60e3c17c6da460a6c2c846bc6c952124fa"}
May 20 20:51:25.644334 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.644302    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmh86" event={"ID":"776416a8-cce7-4e89-8e1f-90f23694b48f","Type":"ContainerStarted","Data":"15ca10050bf636c893f446bddd90cb5f461ff495798efa520ad3e3488c4c280a"}
May 20 20:51:25.667994 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:25.667939    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hmh86" podStartSLOduration=1.3679501539999999 podStartE2EDuration="3.667918687s" podCreationTimestamp="2026-05-20 20:51:22 +0000 UTC" firstStartedPulling="2026-05-20 20:51:23.155151371 +0000 UTC m=+167.548303173" lastFinishedPulling="2026-05-20 20:51:25.455119897 +0000 UTC m=+169.848271706" observedRunningTime="2026-05-20 20:51:25.666830914 +0000 UTC m=+170.059982736" watchObservedRunningTime="2026-05-20 20:51:25.667918687 +0000 UTC m=+170.061070490"
May 20 20:51:27.136978 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.136920    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:51:27.140141 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.140108    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5vsdg\""
May 20 20:51:27.147398 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.147373    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j97vz"
May 20 20:51:27.332551 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.332371    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j97vz"]
May 20 20:51:27.334990 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:27.334959    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5309f4_2558_42c7_9107_acd0d3b08205.slice/crio-c30c6dacae751ad902cdd007ed59d60d950f5f876e03f22fc4bd8c3c4239ae4e WatchSource:0}: Error finding container c30c6dacae751ad902cdd007ed59d60d950f5f876e03f22fc4bd8c3c4239ae4e: Status 404 returned error can't find the container with id c30c6dacae751ad902cdd007ed59d60d950f5f876e03f22fc4bd8c3c4239ae4e
May 20 20:51:27.651494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.651455    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl" event={"ID":"3bad82d2-518b-4383-bec6-5e83738b143b","Type":"ContainerStarted","Data":"3adb59715387a816b82b3a5b7ee8abc1c087554692d1eef83100ffcb84386bb6"}
May 20 20:51:27.652739 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.652709    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j97vz" event={"ID":"bd5309f4-2558-42c7-9107-acd0d3b08205","Type":"ContainerStarted","Data":"c30c6dacae751ad902cdd007ed59d60d950f5f876e03f22fc4bd8c3c4239ae4e"}
May 20 20:51:27.671024 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:27.670965    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-ppcnl" podStartSLOduration=32.972165412 podStartE2EDuration="34.670948833s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:51:25.537326566 +0000 UTC m=+169.930478381" lastFinishedPulling="2026-05-20 20:51:27.236109988 +0000 UTC m=+171.629261802" observedRunningTime="2026-05-20 20:51:27.670362709 +0000 UTC m=+172.063514533" watchObservedRunningTime="2026-05-20 20:51:27.670948833 +0000 UTC m=+172.064100656"
May 20 20:51:28.137304 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:28.137271    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:51:29.660272 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.660234    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j97vz" event={"ID":"bd5309f4-2558-42c7-9107-acd0d3b08205","Type":"ContainerStarted","Data":"cc4403fe976cac5dcec3b75aa02df35fcc7c024dcf8172b288aac96463c3c5e5"}
May 20 20:51:29.683018 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.682964    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j97vz" podStartSLOduration=136.894999553 podStartE2EDuration="2m18.682945513s" podCreationTimestamp="2026-05-20 20:49:11 +0000 UTC" firstStartedPulling="2026-05-20 20:51:27.337005437 +0000 UTC m=+171.730157236" lastFinishedPulling="2026-05-20 20:51:29.124951383 +0000 UTC m=+173.518103196" observedRunningTime="2026-05-20 20:51:29.681487858 +0000 UTC m=+174.074639680" watchObservedRunningTime="2026-05-20 20:51:29.682945513 +0000 UTC m=+174.076097335"
May 20 20:51:29.893079 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.893045    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:51:29.896323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.896293    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.899366 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.899153    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 20 20:51:29.899366 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.899170    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 20 20:51:29.899366 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.899187    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 20 20:51:29.899366 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.899271    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 20 20:51:29.900220 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.900196    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-46kgk\""
May 20 20:51:29.900336 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.900201    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 20 20:51:29.905808 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.905784    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:51:29.997110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.996941    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.997110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.997002    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.997110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.997041    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.997110 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.997102    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.997388 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.997130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js76s\" (UniqueName: \"kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:29.997388 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:29.997170    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098345 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098301    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098361    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098399    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098427    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js76s\" (UniqueName: \"kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098478    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.098537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.098535    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.099153 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.099121    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.099459 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.099435    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.099607 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.099584    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.101277 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.101253    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.101392 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.101372    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.109409 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.109384    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js76s\" (UniqueName: \"kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s\") pod \"console-5cb495f4fb-777lq\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") " pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.207212 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.207145    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:30.355614 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.355582    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:51:30.359013 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:30.358985    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb2590b_b2fc_43be_b843_ef368768da57.slice/crio-9b5568392f96f10771bb725c8e27104715a9f29e78cb1e6dab6011d200ac0e91 WatchSource:0}: Error finding container 9b5568392f96f10771bb725c8e27104715a9f29e78cb1e6dab6011d200ac0e91: Status 404 returned error can't find the container with id 9b5568392f96f10771bb725c8e27104715a9f29e78cb1e6dab6011d200ac0e91
May 20 20:51:30.664418 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.664382    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb495f4fb-777lq" event={"ID":"5bb2590b-b2fc-43be-b843-ef368768da57","Type":"ContainerStarted","Data":"9b5568392f96f10771bb725c8e27104715a9f29e78cb1e6dab6011d200ac0e91"}
May 20 20:51:30.867520 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.867473    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"]
May 20 20:51:30.872033 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.872006    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:30.876271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.876076    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9glv5\""
May 20 20:51:30.876271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.876082    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 20 20:51:30.876271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.876149    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 20:51:30.876271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.876178    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 20 20:51:30.881268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.881246    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"]
May 20 20:51:30.903970 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.903932    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnzw\" (UniqueName: \"kubernetes.io/projected/0bfec882-b54a-491d-ab83-138b1003a438-kube-api-access-rtnzw\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:30.904166 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.903994    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:30.904166 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.904136    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfec882-b54a-491d-ab83-138b1003a438-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:30.904259 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:30.904183    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.005149 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.004814    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfec882-b54a-491d-ab83-138b1003a438-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.005149 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.004883    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.005149 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.004924    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnzw\" (UniqueName: \"kubernetes.io/projected/0bfec882-b54a-491d-ab83-138b1003a438-kube-api-access-rtnzw\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.005149 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.004970    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.005562 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:31.005532    2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 20 20:51:31.005651 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:31.005639    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls podName:0bfec882-b54a-491d-ab83-138b1003a438 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:31.50560292 +0000 UTC m=+175.898754735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-cf2dp" (UID: "0bfec882-b54a-491d-ab83-138b1003a438") : secret "prometheus-operator-tls" not found
May 20 20:51:31.006623 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.006598    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bfec882-b54a-491d-ab83-138b1003a438-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.010422 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.008897    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.016848 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.016815    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnzw\" (UniqueName: \"kubernetes.io/projected/0bfec882-b54a-491d-ab83-138b1003a438-kube-api-access-rtnzw\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.511835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.511790    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.514848 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.514818    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0bfec882-b54a-491d-ab83-138b1003a438-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-cf2dp\" (UID: \"0bfec882-b54a-491d-ab83-138b1003a438\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.629096 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.629044    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4mhkn"
May 20 20:51:31.784783 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.784698    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"
May 20 20:51:31.940784 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:31.940749    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp"]
May 20 20:51:31.944550 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:31.944521    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfec882_b54a_491d_ab83_138b1003a438.slice/crio-e162157c6e2ee0719a637fce1ea47db86b5547131a891eb2b3ae260197c0b412 WatchSource:0}: Error finding container e162157c6e2ee0719a637fce1ea47db86b5547131a891eb2b3ae260197c0b412: Status 404 returned error can't find the container with id e162157c6e2ee0719a637fce1ea47db86b5547131a891eb2b3ae260197c0b412
May 20 20:51:32.604204 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:32.603930    2554 patch_prober.go:28] interesting pod/image-registry-ddf5b7478-467g5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:51:32.604204 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:32.604001    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:51:32.673189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:32.673149    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp" event={"ID":"0bfec882-b54a-491d-ab83-138b1003a438","Type":"ContainerStarted","Data":"e162157c6e2ee0719a637fce1ea47db86b5547131a891eb2b3ae260197c0b412"}
May 20 20:51:39.668237 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.668186    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:51:39.673022 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.672993    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.683050 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.682568    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 20 20:51:39.683501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.683473    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:51:39.787641 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787604    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787823 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787652    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787823 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787910 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787910 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787887    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787978 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kq8g\" (UniqueName: \"kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.787978 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.787934    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889163 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889118    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889352 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889173    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889424 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889363    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889479 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889451    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889534 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889495    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889582 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889557    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kq8g\" (UniqueName: \"kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889628 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889589    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.889952 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.889925    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.890115 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.890090    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.890222 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.890141    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.890572 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.890546    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.892181 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.892158    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.892378 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.892357    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.900232 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.900207    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kq8g\" (UniqueName: \"kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g\") pod \"console-64dcc9ffb-fwqr7\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") " pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:39.986475 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:39.986371    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:40.833275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:40.833200    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:51:40.836542 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:40.836507    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ac84a8_b65c_407d_894a_5cee269d8902.slice/crio-009acb24c95ade9bd1bd36f5e9ecaa323c849bd9eecebc6e3782b5e96ad84370 WatchSource:0}: Error finding container 009acb24c95ade9bd1bd36f5e9ecaa323c849bd9eecebc6e3782b5e96ad84370: Status 404 returned error can't find the container with id 009acb24c95ade9bd1bd36f5e9ecaa323c849bd9eecebc6e3782b5e96ad84370
May 20 20:51:41.701820 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.701784    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp" event={"ID":"0bfec882-b54a-491d-ab83-138b1003a438","Type":"ContainerStarted","Data":"6943f22a08c32d9ff2cf8fbc9ab2d48e91000ccb053fbe3eb512f16adb00b5c2"}
May 20 20:51:41.702010 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.701828    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp" event={"ID":"0bfec882-b54a-491d-ab83-138b1003a438","Type":"ContainerStarted","Data":"c977dc24bfeff814217f0f9a634c29fad2fac5f8006945595701c34b9e422778"}
May 20 20:51:41.703537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.703491    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-jjgfq" event={"ID":"5afb596b-3dbf-4692-a146-4d30c2987e74","Type":"ContainerStarted","Data":"ded90a9b6cd9a5e471fb46af80c32cf5ff006a525d213a32f89df37d2f72caa5"}
May 20 20:51:41.703741 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.703715    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:41.705241 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.705215    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dcc9ffb-fwqr7" event={"ID":"a0ac84a8-b65c-407d-894a-5cee269d8902","Type":"ContainerStarted","Data":"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"}
May 20 20:51:41.705358 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.705250    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dcc9ffb-fwqr7" event={"ID":"a0ac84a8-b65c-407d-894a-5cee269d8902","Type":"ContainerStarted","Data":"009acb24c95ade9bd1bd36f5e9ecaa323c849bd9eecebc6e3782b5e96ad84370"}
May 20 20:51:41.706918 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.706895    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb495f4fb-777lq" event={"ID":"5bb2590b-b2fc-43be-b843-ef368768da57","Type":"ContainerStarted","Data":"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"}
May 20 20:51:41.721150 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.721122    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-jjgfq"
May 20 20:51:41.723466 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.723341    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-cf2dp" podStartSLOduration=2.998271823 podStartE2EDuration="11.723325092s" podCreationTimestamp="2026-05-20 20:51:30 +0000 UTC" firstStartedPulling="2026-05-20 20:51:31.947095988 +0000 UTC m=+176.340247797" lastFinishedPulling="2026-05-20 20:51:40.672149251 +0000 UTC m=+185.065301066" observedRunningTime="2026-05-20 20:51:41.723270771 +0000 UTC m=+186.116422593" watchObservedRunningTime="2026-05-20 20:51:41.723325092 +0000 UTC m=+186.116476917"
May 20 20:51:41.755943 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.755767    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-jjgfq" podStartSLOduration=2.147341681 podStartE2EDuration="19.755748721s" podCreationTimestamp="2026-05-20 20:51:22 +0000 UTC" firstStartedPulling="2026-05-20 20:51:23.125409714 +0000 UTC m=+167.518561515" lastFinishedPulling="2026-05-20 20:51:40.73381674 +0000 UTC m=+185.126968555" observedRunningTime="2026-05-20 20:51:41.754847943 +0000 UTC m=+186.147999765" watchObservedRunningTime="2026-05-20 20:51:41.755748721 +0000 UTC m=+186.148900544"
May 20 20:51:41.777047 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.776982    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5cb495f4fb-777lq" podStartSLOduration=2.4660511 podStartE2EDuration="12.776961671s" podCreationTimestamp="2026-05-20 20:51:29 +0000 UTC" firstStartedPulling="2026-05-20 20:51:30.36118129 +0000 UTC m=+174.754333094" lastFinishedPulling="2026-05-20 20:51:40.672091865 +0000 UTC m=+185.065243665" observedRunningTime="2026-05-20 20:51:41.776114241 +0000 UTC m=+186.169266062" watchObservedRunningTime="2026-05-20 20:51:41.776961671 +0000 UTC m=+186.170113498"
May 20 20:51:41.799032 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:41.798971    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64dcc9ffb-fwqr7" podStartSLOduration=2.7989493420000002 podStartE2EDuration="2.798949342s" podCreationTimestamp="2026-05-20 20:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:41.797940839 +0000 UTC m=+186.191092662" watchObservedRunningTime="2026-05-20 20:51:41.798949342 +0000 UTC m=+186.192101165"
May 20 20:51:42.601241 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:42.601196    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:43.269374 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.269334    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brszx"]
May 20 20:51:43.300238 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.300206    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.303169 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.303127    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wjlh8\""
May 20 20:51:43.303518 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.303496    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 20:51:43.303810 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.303789    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 20:51:43.303937 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.303809    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 20:51:43.422940 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.422896    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-wtmp\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423145 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.422960    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-textfile\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423145 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423051    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-root\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423145 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423145    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2md4x\" (UniqueName: \"kubernetes.io/projected/2699d670-75b8-400f-ac8a-d568ce5e0ac7-kube-api-access-2md4x\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-sys\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423323 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423282    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423445 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423339    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-accelerators-collector-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.423445 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.423373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-metrics-client-ca\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524464 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524385    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-textfile\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524464 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524437    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-root\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524501    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-root\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524581    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524628    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2md4x\" (UniqueName: \"kubernetes.io/projected/2699d670-75b8-400f-ac8a-d568ce5e0ac7-kube-api-access-2md4x\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524659    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-sys\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524877 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:43.524690    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 20:51:43.524877 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524743    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-sys\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524877 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:43.524754    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls podName:2699d670-75b8-400f-ac8a-d568ce5e0ac7 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:44.024734567 +0000 UTC m=+188.417886388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls") pod "node-exporter-brszx" (UID: "2699d670-75b8-400f-ac8a-d568ce5e0ac7") : secret "node-exporter-tls" not found
May 20 20:51:43.524877 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524797    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-textfile\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.524877 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524832    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525228 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524893    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-accelerators-collector-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525228 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524927    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-metrics-client-ca\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525228 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.524991    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-wtmp\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525228 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.525169    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-wtmp\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525540 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.525513    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-accelerators-collector-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.525596 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.525544    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2699d670-75b8-400f-ac8a-d568ce5e0ac7-metrics-client-ca\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.527513 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.527487    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:43.539286 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:43.539258    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2md4x\" (UniqueName: \"kubernetes.io/projected/2699d670-75b8-400f-ac8a-d568ce5e0ac7-kube-api-access-2md4x\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:44.029038 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:44.028998    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:44.031713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:44.031683    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2699d670-75b8-400f-ac8a-d568ce5e0ac7-node-exporter-tls\") pod \"node-exporter-brszx\" (UID: \"2699d670-75b8-400f-ac8a-d568ce5e0ac7\") " pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:44.212588 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:44.212547    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brszx"
May 20 20:51:44.643822 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:44.643788    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5fd8d896-zkfrr"
May 20 20:51:44.717906 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:44.717866    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brszx" event={"ID":"2699d670-75b8-400f-ac8a-d568ce5e0ac7","Type":"ContainerStarted","Data":"bafd80cac2ac1d60df178526a68bfef6e763b5a5d5b2129fa19b066a208e9cc3"}
May 20 20:51:46.726238 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:46.726201    2554 generic.go:358] "Generic (PLEG): container finished" podID="2699d670-75b8-400f-ac8a-d568ce5e0ac7" containerID="006f0e68f798eca44f0e5c30900e74473ea9ef524076887945a3b9a96177bb40" exitCode=0
May 20 20:51:46.726792 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:46.726295    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brszx" event={"ID":"2699d670-75b8-400f-ac8a-d568ce5e0ac7","Type":"ContainerDied","Data":"006f0e68f798eca44f0e5c30900e74473ea9ef524076887945a3b9a96177bb40"}
May 20 20:51:47.615886 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.615804    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerName="registry" containerID="cri-o://ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b" gracePeriod=30
May 20 20:51:47.684246 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.684206    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-757fc576b7-xdqcd"]
May 20 20:51:47.702264 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.702233    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-757fc576b7-xdqcd"]
May 20 20:51:47.702426 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.702387    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.707801 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.707748    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 20 20:51:47.707946 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.707898    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 20 20:51:47.707946 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.707908    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 20 20:51:47.707946 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.707908    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-asm520kr68eri\""
May 20 20:51:47.708149 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.708092    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nbvr6\""
May 20 20:51:47.708374 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.708355    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 20 20:51:47.731321 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.731290    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brszx" event={"ID":"2699d670-75b8-400f-ac8a-d568ce5e0ac7","Type":"ContainerStarted","Data":"8cd3124bd3dcf7d9c4c8e0ff784f6cf283196e2ac00a637edc14e36179dcf67a"}
May 20 20:51:47.731702 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.731329    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brszx" event={"ID":"2699d670-75b8-400f-ac8a-d568ce5e0ac7","Type":"ContainerStarted","Data":"6d50f5a56ae709083deab575b78f766b30e4c8adcbd5c81c585805e1227cb275"}
May 20 20:51:47.754920 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.754870    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brszx" podStartSLOduration=3.2186026070000002 podStartE2EDuration="4.754850763s" podCreationTimestamp="2026-05-20 20:51:43 +0000 UTC" firstStartedPulling="2026-05-20 20:51:44.229025661 +0000 UTC m=+188.622177477" lastFinishedPulling="2026-05-20 20:51:45.765273824 +0000 UTC m=+190.158425633" observedRunningTime="2026-05-20 20:51:47.754251664 +0000 UTC m=+192.147403486" watchObservedRunningTime="2026-05-20 20:51:47.754850763 +0000 UTC m=+192.148002588"
May 20 20:51:47.867283 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867283 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bf9c082-0d58-497f-af36-a261a967901a-audit-log\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867596 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867566    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-metrics-server-audit-profiles\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867678 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867614    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-client-certs\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867678 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-tls\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867791 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997pc\" (UniqueName: \"kubernetes.io/projected/9bf9c082-0d58-497f-af36-a261a967901a-kube-api-access-997pc\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.867791 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.867750    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-client-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.890829 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.890811    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:47.969239 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969197    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969239 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969245    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bf9c082-0d58-497f-af36-a261a967901a-audit-log\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969312    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-metrics-server-audit-profiles\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969340    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-client-certs\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969365    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-tls\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969394    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-997pc\" (UniqueName: \"kubernetes.io/projected/9bf9c082-0d58-497f-af36-a261a967901a-kube-api-access-997pc\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969501 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969423    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-client-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.969755 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.969709    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9bf9c082-0d58-497f-af36-a261a967901a-audit-log\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.971672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.970243    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.971672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.971623    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9bf9c082-0d58-497f-af36-a261a967901a-metrics-server-audit-profiles\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.972609 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.972584    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-client-ca-bundle\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.972726 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.972589    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-tls\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.972786 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.972718    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9bf9c082-0d58-497f-af36-a261a967901a-secret-metrics-server-client-certs\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:47.989403 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:47.989374    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997pc\" (UniqueName: \"kubernetes.io/projected/9bf9c082-0d58-497f-af36-a261a967901a-kube-api-access-997pc\") pod \"metrics-server-757fc576b7-xdqcd\" (UID: \"9bf9c082-0d58-497f-af36-a261a967901a\") " pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:48.029051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.029007    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:51:48.070629 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070575    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070629 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070626    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070658    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s4fl\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070692    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070736    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070779    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070817    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.070881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.070868    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token\") pod \"e8a906ef-00c4-437b-ae6d-ac820db8885f\" (UID: \"e8a906ef-00c4-437b-ae6d-ac820db8885f\") "
May 20 20:51:48.071902 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.071869    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:51:48.072473 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.072417    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:51:48.075132 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.075061    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:51:48.075228 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.075207    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:51:48.075321 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.075303    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl" (OuterVolumeSpecName: "kube-api-access-7s4fl") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "kube-api-access-7s4fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:51:48.075398 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.075337    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:51:48.075762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.075729    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:51:48.082836 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.082816    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e8a906ef-00c4-437b-ae6d-ac820db8885f" (UID: "e8a906ef-00c4-437b-ae6d-ac820db8885f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:51:48.083099 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.083025    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"]
May 20 20:51:48.083456 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.083435    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerName="registry"
May 20 20:51:48.083516 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.083461    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerName="registry"
May 20 20:51:48.083562 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.083550    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerName="registry"
May 20 20:51:48.125208 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.125111    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"]
May 20 20:51:48.125354 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.125292    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:48.129584 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.129358    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-t5fxm\""
May 20 20:51:48.129584 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.129473    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 20 20:51:48.172684 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172647    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-bound-sa-token\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172684 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172673    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-trusted-ca\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172684 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172682    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-tls\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172691    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s4fl\" (UniqueName: \"kubernetes.io/projected/e8a906ef-00c4-437b-ae6d-ac820db8885f-kube-api-access-7s4fl\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172702    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-image-registry-private-configuration\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172717    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8a906ef-00c4-437b-ae6d-ac820db8885f-ca-trust-extracted\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172734    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8a906ef-00c4-437b-ae6d-ac820db8885f-installation-pull-secrets\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.172936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.172746    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8a906ef-00c4-437b-ae6d-ac820db8885f-registry-certificates\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:51:48.192822 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.192787    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-757fc576b7-xdqcd"]
May 20 20:51:48.196733 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:48.196700    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf9c082_0d58_497f_af36_a261a967901a.slice/crio-eaf1cdec55cbe96fe3fcbee2a7b59b3238f5e29ebd163eb96ca46e7d49343c3a WatchSource:0}: Error finding container eaf1cdec55cbe96fe3fcbee2a7b59b3238f5e29ebd163eb96ca46e7d49343c3a: Status 404 returned error can't find the container with id eaf1cdec55cbe96fe3fcbee2a7b59b3238f5e29ebd163eb96ca46e7d49343c3a
May 20 20:51:48.274031 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.273992    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fdf0e2be-9028-4481-b11e-8c9e4bdeb732-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6t6pj\" (UID: \"fdf0e2be-9028-4481-b11e-8c9e4bdeb732\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:48.374726 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.374685    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fdf0e2be-9028-4481-b11e-8c9e4bdeb732-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6t6pj\" (UID: \"fdf0e2be-9028-4481-b11e-8c9e4bdeb732\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:48.377517 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.377447    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fdf0e2be-9028-4481-b11e-8c9e4bdeb732-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-6t6pj\" (UID: \"fdf0e2be-9028-4481-b11e-8c9e4bdeb732\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:48.440484 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.440451    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:48.559038 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.558980    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"]
May 20 20:51:48.586406 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.586379    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.594086 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.592210    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"]
May 20 20:51:48.602087 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.599791    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 20 20:51:48.602087 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.600096    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 20 20:51:48.602087 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.600301    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bhsxl\""
May 20 20:51:48.602087 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.601307    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 20 20:51:48.607023 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.603300    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 20 20:51:48.607023 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.603554    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 20 20:51:48.612015 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.611985    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 20 20:51:48.634715 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.634627    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"]
May 20 20:51:48.639364 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:48.639338    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf0e2be_9028_4481_b11e_8c9e4bdeb732.slice/crio-e3515a544d36a24f5ebb8cf6a4774cb28288f7fb11e9e9bddcf8e456918d7394 WatchSource:0}: Error finding container e3515a544d36a24f5ebb8cf6a4774cb28288f7fb11e9e9bddcf8e456918d7394: Status 404 returned error can't find the container with id e3515a544d36a24f5ebb8cf6a4774cb28288f7fb11e9e9bddcf8e456918d7394
May 20 20:51:48.677523 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-federate-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677685 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677537    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-serving-certs-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677685 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-metrics-client-ca\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677685 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677636    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55drh\" (UniqueName: \"kubernetes.io/projected/4ec569b8-3456-4ecd-962c-88cebe1fda99-kube-api-access-55drh\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677840 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677840 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677792    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677920 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677889    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.677962 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.677930    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.735341 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.735291    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj" event={"ID":"fdf0e2be-9028-4481-b11e-8c9e4bdeb732","Type":"ContainerStarted","Data":"e3515a544d36a24f5ebb8cf6a4774cb28288f7fb11e9e9bddcf8e456918d7394"}
May 20 20:51:48.736713 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.736682    2554 generic.go:358] "Generic (PLEG): container finished" podID="e8a906ef-00c4-437b-ae6d-ac820db8885f" containerID="ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b" exitCode=0
May 20 20:51:48.736850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.736756    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" event={"ID":"e8a906ef-00c4-437b-ae6d-ac820db8885f","Type":"ContainerDied","Data":"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"}
May 20 20:51:48.736850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.736759    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddf5b7478-467g5"
May 20 20:51:48.736850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.736784    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddf5b7478-467g5" event={"ID":"e8a906ef-00c4-437b-ae6d-ac820db8885f","Type":"ContainerDied","Data":"8ba075e36d4dccec821547e33821d11b7a97654d704b88e278a8cf537a42d8d5"}
May 20 20:51:48.736850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.736804    2554 scope.go:117] "RemoveContainer" containerID="ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"
May 20 20:51:48.737965 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.737942    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd" event={"ID":"9bf9c082-0d58-497f-af36-a261a967901a","Type":"ContainerStarted","Data":"eaf1cdec55cbe96fe3fcbee2a7b59b3238f5e29ebd163eb96ca46e7d49343c3a"}
May 20 20:51:48.745706 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.745681    2554 scope.go:117] "RemoveContainer" containerID="ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"
May 20 20:51:48.745990 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:51:48.745961    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b\": container with ID starting with ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b not found: ID does not exist" containerID="ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"
May 20 20:51:48.746086 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.746003    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b"} err="failed to get container status \"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b\": rpc error: code = NotFound desc = could not find container \"ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b\": container with ID starting with ab7c63a0db67299050cbcac0d51d9ddf047830f0f586cfc0cecddb4dbd18435b not found: ID does not exist"
May 20 20:51:48.763396 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.763366    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:51:48.768950 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.768924    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-ddf5b7478-467g5"]
May 20 20:51:48.778661 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778628    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778826 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778677    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778826 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778729    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-federate-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778826 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778781    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-serving-certs-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778856    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-metrics-client-ca\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778906    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55drh\" (UniqueName: \"kubernetes.io/projected/4ec569b8-3456-4ecd-962c-88cebe1fda99-kube-api-access-55drh\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.778975 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778966    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.779167 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.778995    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.779728 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.779696    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-serving-certs-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.779943 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.779863    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.780106 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.780012    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec569b8-3456-4ecd-962c-88cebe1fda99-metrics-client-ca\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.781828 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.781788    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-federate-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.781828 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.781811    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.782081 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.782029    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-secret-telemeter-client\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.782187 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.782160    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4ec569b8-3456-4ecd-962c-88cebe1fda99-telemeter-client-tls\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.789505 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.789485    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55drh\" (UniqueName: \"kubernetes.io/projected/4ec569b8-3456-4ecd-962c-88cebe1fda99-kube-api-access-55drh\") pod \"telemeter-client-677fd4b6c9-kc5hr\" (UID: \"4ec569b8-3456-4ecd-962c-88cebe1fda99\") " pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:48.908098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:48.907991    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"
May 20 20:51:49.080509 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.080432    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr"]
May 20 20:51:49.085318 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:49.085285    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec569b8_3456_4ecd_962c_88cebe1fda99.slice/crio-484af25bd1b3bdf601b21cf5bfdde63e59738164a27052469316b8e6dba5e3fe WatchSource:0}: Error finding container 484af25bd1b3bdf601b21cf5bfdde63e59738164a27052469316b8e6dba5e3fe: Status 404 returned error can't find the container with id 484af25bd1b3bdf601b21cf5bfdde63e59738164a27052469316b8e6dba5e3fe
May 20 20:51:49.667606 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.666889    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:51:49.691689 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.691657    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:51:49.692047 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.692027    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.697422    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.697694    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.697867    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6zjx4\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.698034    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.698213    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dc0jspis56b46\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.698378    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.699083    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.699299    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.700170    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.700483    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.700619    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 20 20:51:49.701191 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.700649    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 20 20:51:49.704617 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.704593    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 20 20:51:49.710268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.708295    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 20 20:51:49.747089 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.746955    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr" event={"ID":"4ec569b8-3456-4ecd-962c-88cebe1fda99","Type":"ContainerStarted","Data":"484af25bd1b3bdf601b21cf5bfdde63e59738164a27052469316b8e6dba5e3fe"}
May 20 20:51:49.792454 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792454 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792389    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792454 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792422    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792497    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792547    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792594    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792677    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.792762 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792788    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zj4b\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792818    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792859    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792885    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792951    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.793183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.792980    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.893696 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893604    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.893696 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893682    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.893977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893715    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.893977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893741    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.893977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893913    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894178 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.893982    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894178 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894057    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894178 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894120    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894331 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894196    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894331 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894229    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894331 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894280    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894331 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894305    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894342    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zj4b\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894376    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894421    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894445    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894489    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894528 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894521    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.894809 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.894750    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.895058 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.895028    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.895420 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.895167    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.895638 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.895607    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.895807 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.895783    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.901006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.900978    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.902213 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.902188    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.902366 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.902325    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.902656 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.902605    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.903185 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.903144    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.903556    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.903627    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.903938    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.904059    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.904084    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.904940 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.904887    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.907835 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.907781    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.912103 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.912081    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zj4b\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b\") pod \"prometheus-k8s-0\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:49.988303 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.987022    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:49.988303 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.987897    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:49.994478 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:49.994421    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:50.018158 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.018124    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:51:50.142603 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.142565    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a906ef-00c4-437b-ae6d-ac820db8885f" path="/var/lib/kubelet/pods/e8a906ef-00c4-437b-ae6d-ac820db8885f/volumes"
May 20 20:51:50.207971 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.207934    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:50.208151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.207988    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:50.212504 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.212483    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:50.753946 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.753919    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:51:50.754428 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.754412    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:51:50.828623 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:50.828574    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:51:51.917050 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:51.917007    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:51:51.923194 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:51:51.923170    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdc5fa2_9fd1_44c8_9434_1a6c837c4bae.slice/crio-6431a847762f10574de88ac7d63226fc464e1abd07798a4813099114e27ad453 WatchSource:0}: Error finding container 6431a847762f10574de88ac7d63226fc464e1abd07798a4813099114e27ad453: Status 404 returned error can't find the container with id 6431a847762f10574de88ac7d63226fc464e1abd07798a4813099114e27ad453
May 20 20:51:52.757415 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.757381    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj" event={"ID":"fdf0e2be-9028-4481-b11e-8c9e4bdeb732","Type":"ContainerStarted","Data":"ffa0db61817760fc977b44c8c5cae32057f2f9cac59abfa506fb8a5dab52c80f"}
May 20 20:51:52.757621 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.757575    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:52.758691 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.758659    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"6431a847762f10574de88ac7d63226fc464e1abd07798a4813099114e27ad453"}
May 20 20:51:52.760188 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.760151    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd" event={"ID":"9bf9c082-0d58-497f-af36-a261a967901a","Type":"ContainerStarted","Data":"369fde7d188a8ea7f85fa1008f622c49fcfb7bee19307cee11e121f44eab5852"}
May 20 20:51:52.761660 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.761635    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr" event={"ID":"4ec569b8-3456-4ecd-962c-88cebe1fda99","Type":"ContainerStarted","Data":"0144646004b2a6ae7f4e0adfdbc4f23c52daa21a326e72c23f31422dcb230973"}
May 20 20:51:52.763237 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.763214    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj"
May 20 20:51:52.777881 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.777826    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-6t6pj" podStartSLOduration=1.651847927 podStartE2EDuration="4.777804884s" podCreationTimestamp="2026-05-20 20:51:48 +0000 UTC" firstStartedPulling="2026-05-20 20:51:48.641814036 +0000 UTC m=+193.034965835" lastFinishedPulling="2026-05-20 20:51:51.767770977 +0000 UTC m=+196.160922792" observedRunningTime="2026-05-20 20:51:52.776797804 +0000 UTC m=+197.169949626" watchObservedRunningTime="2026-05-20 20:51:52.777804884 +0000 UTC m=+197.170956706"
May 20 20:51:52.807932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:52.807868    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd" podStartSLOduration=2.239164323 podStartE2EDuration="5.807854331s" podCreationTimestamp="2026-05-20 20:51:47 +0000 UTC" firstStartedPulling="2026-05-20 20:51:48.198904072 +0000 UTC m=+192.592055875" lastFinishedPulling="2026-05-20 20:51:51.767594071 +0000 UTC m=+196.160745883" observedRunningTime="2026-05-20 20:51:52.806500896 +0000 UTC m=+197.199652729" watchObservedRunningTime="2026-05-20 20:51:52.807854331 +0000 UTC m=+197.201006154"
May 20 20:51:53.765860 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:53.765822    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001" exitCode=0
May 20 20:51:53.766330 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:53.765912    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"}
May 20 20:51:53.767933 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:53.767907    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr" event={"ID":"4ec569b8-3456-4ecd-962c-88cebe1fda99","Type":"ContainerStarted","Data":"ba1ac3c02019da65af29cbc1c21d07a0d38f158e90157de1097f6fadc273e8fa"}
May 20 20:51:53.768016 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:53.767942    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr" event={"ID":"4ec569b8-3456-4ecd-962c-88cebe1fda99","Type":"ContainerStarted","Data":"1cc99d106d8277c6322d78e333c751096658e16d16b09b8e330e00579d1cdd4a"}
May 20 20:51:57.786178 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:57.786135    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"}
May 20 20:51:57.786540 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:51:57.786187    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"}
May 20 20:52:00.799490 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.799450    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"}
May 20 20:52:00.799490 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.799494    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"}
May 20 20:52:00.800027 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.799506    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"}
May 20 20:52:00.800027 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.799517    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerStarted","Data":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"}
May 20 20:52:00.860518 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.860461    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677fd4b6c9-kc5hr" podStartSLOduration=8.537972337 podStartE2EDuration="12.860443789s" podCreationTimestamp="2026-05-20 20:51:48 +0000 UTC" firstStartedPulling="2026-05-20 20:51:49.088049858 +0000 UTC m=+193.481201661" lastFinishedPulling="2026-05-20 20:51:53.41052131 +0000 UTC m=+197.803673113" observedRunningTime="2026-05-20 20:51:53.851367325 +0000 UTC m=+198.244519148" watchObservedRunningTime="2026-05-20 20:52:00.860443789 +0000 UTC m=+205.253595610"
May 20 20:52:00.861026 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:00.860998    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.887224324 podStartE2EDuration="11.860989228s" podCreationTimestamp="2026-05-20 20:51:49 +0000 UTC" firstStartedPulling="2026-05-20 20:51:51.92526414 +0000 UTC m=+196.318415940" lastFinishedPulling="2026-05-20 20:51:59.89902904 +0000 UTC m=+204.292180844" observedRunningTime="2026-05-20 20:52:00.860831186 +0000 UTC m=+205.253983007" watchObservedRunningTime="2026-05-20 20:52:00.860989228 +0000 UTC m=+205.254141054"
May 20 20:52:05.019120 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:05.019053    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:52:06.412797 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:06.412761    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:52:08.029650 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:08.029602    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:52:08.029650 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:08.029656    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:52:12.844043 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:12.844009    2554 generic.go:358] "Generic (PLEG): container finished" podID="8a6ba428-9f03-412d-8813-b31775e6a0c3" containerID="c77b192cf86d621794479ef3677577112dd81c1494ff99131ecd083828c6c211" exitCode=0
May 20 20:52:12.844436 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:12.844043    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc" event={"ID":"8a6ba428-9f03-412d-8813-b31775e6a0c3","Type":"ContainerDied","Data":"c77b192cf86d621794479ef3677577112dd81c1494ff99131ecd083828c6c211"}
May 20 20:52:12.844436 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:12.844376    2554 scope.go:117] "RemoveContainer" containerID="c77b192cf86d621794479ef3677577112dd81c1494ff99131ecd083828c6c211"
May 20 20:52:13.849485 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:13.849447    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-j6grc" event={"ID":"8a6ba428-9f03-412d-8813-b31775e6a0c3","Type":"ContainerStarted","Data":"c69ca43418e6ad4c178f7e12df8a5077fbbd139db36bd125ed581feb6a5d7df5"}
May 20 20:52:17.782977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:17.782925    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5cb495f4fb-777lq" podUID="5bb2590b-b2fc-43be-b843-ef368768da57" containerName="console" containerID="cri-o://e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb" gracePeriod=15
May 20 20:52:18.022606 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.022570    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j97vz_bd5309f4-2558-42c7-9107-acd0d3b08205/serve-healthcheck-canary/0.log"
May 20 20:52:18.038437 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.038385    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cb495f4fb-777lq_5bb2590b-b2fc-43be-b843-ef368768da57/console/0.log"
May 20 20:52:18.038539 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.038450    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:52:18.155225 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155192    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155442 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155239    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155442 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155285    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155442 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155331    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155442 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155380    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js76s\" (UniqueName: \"kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155654 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155473    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert\") pod \"5bb2590b-b2fc-43be-b843-ef368768da57\" (UID: \"5bb2590b-b2fc-43be-b843-ef368768da57\") "
May 20 20:52:18.155704 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155642    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:18.155704 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155687    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config" (OuterVolumeSpecName: "console-config") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:18.155796 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155710    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca" (OuterVolumeSpecName: "service-ca") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:18.161740 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.155768    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-oauth-serving-cert\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.161740 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.156245    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-console-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.161740 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.157999    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:18.161740 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.160054    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:18.162054 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.161822    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s" (OuterVolumeSpecName: "kube-api-access-js76s") pod "5bb2590b-b2fc-43be-b843-ef368768da57" (UID: "5bb2590b-b2fc-43be-b843-ef368768da57"). InnerVolumeSpecName "kube-api-access-js76s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:52:18.257734 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.257697    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-serving-cert\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.257734 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.257729    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bb2590b-b2fc-43be-b843-ef368768da57-console-oauth-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.257734 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.257740    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2590b-b2fc-43be-b843-ef368768da57-service-ca\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.257734 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.257750    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js76s\" (UniqueName: \"kubernetes.io/projected/5bb2590b-b2fc-43be-b843-ef368768da57-kube-api-access-js76s\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:18.864980 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.864948    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cb495f4fb-777lq_5bb2590b-b2fc-43be-b843-ef368768da57/console/0.log"
May 20 20:52:18.865447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.864996    2554 generic.go:358] "Generic (PLEG): container finished" podID="5bb2590b-b2fc-43be-b843-ef368768da57" containerID="e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb" exitCode=2
May 20 20:52:18.865447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.865095    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb495f4fb-777lq" event={"ID":"5bb2590b-b2fc-43be-b843-ef368768da57","Type":"ContainerDied","Data":"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"}
May 20 20:52:18.865447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.865136    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb495f4fb-777lq" event={"ID":"5bb2590b-b2fc-43be-b843-ef368768da57","Type":"ContainerDied","Data":"9b5568392f96f10771bb725c8e27104715a9f29e78cb1e6dab6011d200ac0e91"}
May 20 20:52:18.865447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.865151    2554 scope.go:117] "RemoveContainer" containerID="e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"
May 20 20:52:18.865447 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.865103    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb495f4fb-777lq"
May 20 20:52:18.873674 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.873658    2554 scope.go:117] "RemoveContainer" containerID="e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"
May 20 20:52:18.874013 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:52:18.873994    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb\": container with ID starting with e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb not found: ID does not exist" containerID="e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"
May 20 20:52:18.874111 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.874022    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb"} err="failed to get container status \"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb\": rpc error: code = NotFound desc = could not find container \"e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb\": container with ID starting with e6b7dafaf7541dec98634bcd68c50c048565bfda5fc26f7c57106b9fe16ee4cb not found: ID does not exist"
May 20 20:52:18.889091 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.889042    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:52:18.894705 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:18.894675    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb495f4fb-777lq"]
May 20 20:52:20.140539 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:20.140509    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb2590b-b2fc-43be-b843-ef368768da57" path="/var/lib/kubelet/pods/5bb2590b-b2fc-43be-b843-ef368768da57/volumes"
May 20 20:52:28.034445 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:28.034411    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:52:28.039131 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:28.039105    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-757fc576b7-xdqcd"
May 20 20:52:31.432499 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.432444    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64dcc9ffb-fwqr7" podUID="a0ac84a8-b65c-407d-894a-5cee269d8902" containerName="console" containerID="cri-o://f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe" gracePeriod=15
May 20 20:52:31.726778 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.726746    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64dcc9ffb-fwqr7_a0ac84a8-b65c-407d-894a-5cee269d8902/console/0.log"
May 20 20:52:31.726905 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.726824    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:52:31.880170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880138    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880225    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880272    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880329 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880318    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880359    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880394    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880494 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880422    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kq8g\" (UniqueName: \"kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g\") pod \"a0ac84a8-b65c-407d-894a-5cee269d8902\" (UID: \"a0ac84a8-b65c-407d-894a-5cee269d8902\") "
May 20 20:52:31.880746 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880718    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:31.880746 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.880714    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:31.881037 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.881009    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:31.881274 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.881249    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config" (OuterVolumeSpecName: "console-config") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:31.882456 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.882427    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:31.882618 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.882599    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g" (OuterVolumeSpecName: "kube-api-access-9kq8g") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "kube-api-access-9kq8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:52:31.882667 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.882625    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0ac84a8-b65c-407d-894a-5cee269d8902" (UID: "a0ac84a8-b65c-407d-894a-5cee269d8902"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:31.911115 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911026    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64dcc9ffb-fwqr7_a0ac84a8-b65c-407d-894a-5cee269d8902/console/0.log"
May 20 20:52:31.911268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911164    2554 generic.go:358] "Generic (PLEG): container finished" podID="a0ac84a8-b65c-407d-894a-5cee269d8902" containerID="f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe" exitCode=2
May 20 20:52:31.911268 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911256    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dcc9ffb-fwqr7"
May 20 20:52:31.911361 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911253    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dcc9ffb-fwqr7" event={"ID":"a0ac84a8-b65c-407d-894a-5cee269d8902","Type":"ContainerDied","Data":"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"}
May 20 20:52:31.911402 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911367    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dcc9ffb-fwqr7" event={"ID":"a0ac84a8-b65c-407d-894a-5cee269d8902","Type":"ContainerDied","Data":"009acb24c95ade9bd1bd36f5e9ecaa323c849bd9eecebc6e3782b5e96ad84370"}
May 20 20:52:31.911402 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.911388    2554 scope.go:117] "RemoveContainer" containerID="f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"
May 20 20:52:31.919390 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.919314    2554 scope.go:117] "RemoveContainer" containerID="f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"
May 20 20:52:31.919696 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:52:31.919664    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe\": container with ID starting with f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe not found: ID does not exist" containerID="f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"
May 20 20:52:31.919794 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.919696    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe"} err="failed to get container status \"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe\": rpc error: code = NotFound desc = could not find container \"f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe\": container with ID starting with f63b3269520089af5b89631102bf8283a24c12ac47dca376ce999c77726747fe not found: ID does not exist"
May 20 20:52:31.935665 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.935636    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:52:31.940906 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.940880    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64dcc9ffb-fwqr7"]
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981727    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-oauth-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981762    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0ac84a8-b65c-407d-894a-5cee269d8902-console-serving-cert\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981780    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-service-ca\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981793    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-console-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981806    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-trusted-ca-bundle\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.981821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981819    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0ac84a8-b65c-407d-894a-5cee269d8902-oauth-serving-cert\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:31.982146 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:31.981833    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kq8g\" (UniqueName: \"kubernetes.io/projected/a0ac84a8-b65c-407d-894a-5cee269d8902-kube-api-access-9kq8g\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:52:32.141215 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:32.141184    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ac84a8-b65c-407d-894a-5cee269d8902" path="/var/lib/kubelet/pods/a0ac84a8-b65c-407d-894a-5cee269d8902/volumes"
May 20 20:52:47.909420 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:47.909376    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:52:47.911738 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:47.911717    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada6c35e-823a-48ae-b194-127f1eb3dda3-metrics-certs\") pod \"network-metrics-daemon-l6twf\" (UID: \"ada6c35e-823a-48ae-b194-127f1eb3dda3\") " pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:52:47.940560 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:47.940534    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q28sq\""
May 20 20:52:47.947840 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:47.947819    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6twf"
May 20 20:52:48.078143 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:48.078107    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6twf"]
May 20 20:52:48.082149 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:52:48.082120    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada6c35e_823a_48ae_b194_127f1eb3dda3.slice/crio-f513f720545da89983be7b2448009ca6ad89cd8d6fda6c8dc363866cca073c81 WatchSource:0}: Error finding container f513f720545da89983be7b2448009ca6ad89cd8d6fda6c8dc363866cca073c81: Status 404 returned error can't find the container with id f513f720545da89983be7b2448009ca6ad89cd8d6fda6c8dc363866cca073c81
May 20 20:52:48.965632 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:48.965598    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6twf" event={"ID":"ada6c35e-823a-48ae-b194-127f1eb3dda3","Type":"ContainerStarted","Data":"f513f720545da89983be7b2448009ca6ad89cd8d6fda6c8dc363866cca073c81"}
May 20 20:52:49.971259 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:49.971216    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6twf" event={"ID":"ada6c35e-823a-48ae-b194-127f1eb3dda3","Type":"ContainerStarted","Data":"2ef02edb0715cd967f5cf8ac8a3ca43173a9706ba6099f60724c7d13a3293c77"}
May 20 20:52:49.971259 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:49.971263    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6twf" event={"ID":"ada6c35e-823a-48ae-b194-127f1eb3dda3","Type":"ContainerStarted","Data":"64ae09e7dfaeb4b13e899faf5363e67989baaef8cd825e2b065b2e298343f187"}
May 20 20:52:49.992987 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:49.992929    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l6twf" podStartSLOduration=252.958590659 podStartE2EDuration="4m13.992910266s" podCreationTimestamp="2026-05-20 20:48:36 +0000 UTC" firstStartedPulling="2026-05-20 20:52:48.084114703 +0000 UTC m=+252.477266504" lastFinishedPulling="2026-05-20 20:52:49.118434298 +0000 UTC m=+253.511586111" observedRunningTime="2026-05-20 20:52:49.990633559 +0000 UTC m=+254.383785394" watchObservedRunningTime="2026-05-20 20:52:49.992910266 +0000 UTC m=+254.386062088"
May 20 20:52:50.019314 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:50.019249    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:52:50.039977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:50.039950    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:52:50.994172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:52:50.994141    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:08.057673 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.057577    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:08.058326 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058209    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="prometheus" containerID="cri-o://1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c" gracePeriod=600
May 20 20:53:08.058326 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058238    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-web" containerID="cri-o://9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d" gracePeriod=600
May 20 20:53:08.058326 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058281    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8" gracePeriod=600
May 20 20:53:08.058695 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058238    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy" containerID="cri-o://f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec" gracePeriod=600
May 20 20:53:08.058695 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058286    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="thanos-sidecar" containerID="cri-o://bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab" gracePeriod=600
May 20 20:53:08.058695 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.058271    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="config-reloader" containerID="cri-o://97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9" gracePeriod=600
May 20 20:53:08.334864 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.334839    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:08.392895 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.392859    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393233 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.392908    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393233 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.392956    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393233 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.392986    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393427 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393323    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393427 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393359    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393427 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393398    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zj4b\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393579 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393429    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393579 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393479    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393579 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393504    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393579 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393535    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393582    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393623    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393660    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393689    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393716    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.393776 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393747    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.394085 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393779    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config\") pod \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\" (UID: \"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae\") "
May 20 20:53:08.394551 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.393321    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:08.394551 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.394208    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.395519    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.395839    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.396014    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.396704    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.396925    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.397205 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.397157    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:53:08.397944 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.397900    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.398057 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.398011    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.398177 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.398108    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config" (OuterVolumeSpecName: "config") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.398759 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.398730    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.399453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.399428    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out" (OuterVolumeSpecName: "config-out") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:53:08.399911 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.399877    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:53:08.399911 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.399887    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.400170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.400136    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b" (OuterVolumeSpecName: "kube-api-access-8zj4b") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "kube-api-access-8zj4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:53:08.400739 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.400716    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.412617 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.412568    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config" (OuterVolumeSpecName: "web-config") pod "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" (UID: "5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:08.495415 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495372    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495415 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495411    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495426    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zj4b\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-kube-api-access-8zj4b\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495441    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495455    2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-grpc-tls\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495470    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-tls-assets\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495481    2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495499    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-metrics-client-ca\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495512    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-db\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495525    2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-kube-rbac-proxy\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495537    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495552    2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495565    2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-metrics-client-certs\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495579    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-web-config\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495593    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495607    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-config-out\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495621    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:08.495672 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:08.495636    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:53:09.029138 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029092    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8" exitCode=0
May 20 20:53:09.029138 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029125    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec" exitCode=0
May 20 20:53:09.029138 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029136    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d" exitCode=0
May 20 20:53:09.029138 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029144    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab" exitCode=0
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029154    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9" exitCode=0
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029163    2554 generic.go:358] "Generic (PLEG): container finished" podID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c" exitCode=0
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029161    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029202    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029212    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029219    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029230    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029221    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029344    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029363    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"}
May 20 20:53:09.029440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.029378    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae","Type":"ContainerDied","Data":"6431a847762f10574de88ac7d63226fc464e1abd07798a4813099114e27ad453"}
May 20 20:53:09.039821 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.039794    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.047278 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.047252    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.053873 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.053851    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.060381 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.060208    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.066958 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.066933    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:09.067919 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.067905    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.085751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.085729    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.094092 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094053    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.094400 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.094375    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.094475 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094408    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.094475 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094429    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.094699 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.094682    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.094739 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094706    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.094739 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094721    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.094966 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.094948    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.095025 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094968    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.095025 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.094980    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.095498 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.095476    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.095545 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.095506    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.095545 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.095523    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.095763 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.095746    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.095806 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.095768    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.095806 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.095789    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.095995 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.095980    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.096038 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096024    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.096136 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096039    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.096292 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:53:09.096274    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.096339 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096297    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.096339 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096312    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.096487 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096472    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.096541 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096487    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.096665 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096647    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.096721 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096667    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.096846 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096830    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.096892 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.096845    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.097032 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097017    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.097089 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097032    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.097238 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097221    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.097278 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097238    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.097420 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097401    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.097481 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097421    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.097651 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097630    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.097723 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097654    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.097873 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097856    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.097933 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.097875    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.098097 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098079    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.098151 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098097    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.098289 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098272    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.098342 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098288    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.098499 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098482    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.098549 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098499    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.098699 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098684    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.098745 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098699    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.098885 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098871    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.098932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.098885    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.099092 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099077    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.099135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099092    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.099271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099257    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.099319 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099271    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.099448 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099431    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.099510 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099448    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.099669 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099655    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.099710 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099668    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.099878 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099857    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.099878 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.099878    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.100129 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100107    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.100190 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100130    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.100331 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100311    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.100401 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100332    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.100537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100519    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.100602 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100538    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.100751 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100733    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.100798 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100752    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.100958 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100937    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.101002 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.100959    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.101162 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101139    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.101271 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101164    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.101403 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101385    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.101453 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101404    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.101576 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101562    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.101620 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101576    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.101731 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101711    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.101795 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101732    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.101947 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101933    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.101985 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.101947    2554 scope.go:117] "RemoveContainer" containerID="fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"
May 20 20:53:09.102183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102162    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8"} err="failed to get container status \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": rpc error: code = NotFound desc = could not find container \"fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8\": container with ID starting with fff9a7d6bc450c7a60b119e198177275ee662a934e6cf9dbcfa87b5554f036d8 not found: ID does not exist"
May 20 20:53:09.102183 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102182    2554 scope.go:117] "RemoveContainer" containerID="f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"
May 20 20:53:09.102389 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102372    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec"} err="failed to get container status \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": rpc error: code = NotFound desc = could not find container \"f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec\": container with ID starting with f8388f7642aaf1734e2faeb6280108058a1c4f7583e30ef18137df5924888eec not found: ID does not exist"
May 20 20:53:09.102389 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102389    2554 scope.go:117] "RemoveContainer" containerID="9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"
May 20 20:53:09.102615 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102598    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d"} err="failed to get container status \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": rpc error: code = NotFound desc = could not find container \"9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d\": container with ID starting with 9fe840626ac4d4da9264c52956249c47e36dad1c9e6d1c27435ea5adaa8fa21d not found: ID does not exist"
May 20 20:53:09.102674 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102617    2554 scope.go:117] "RemoveContainer" containerID="bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"
May 20 20:53:09.102829 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102812    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab"} err="failed to get container status \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": rpc error: code = NotFound desc = could not find container \"bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab\": container with ID starting with bb188828db208fc7572ac70f979e10804ab3f41f25f02375d7a36a954a47fbab not found: ID does not exist"
May 20 20:53:09.102878 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.102829    2554 scope.go:117] "RemoveContainer" containerID="97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"
May 20 20:53:09.103038 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.103020    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9"} err="failed to get container status \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": rpc error: code = NotFound desc = could not find container \"97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9\": container with ID starting with 97bb15f1481d856158332c79a95103550fc3a66c35f001d4c6d4c0807743afa9 not found: ID does not exist"
May 20 20:53:09.103128 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.103038    2554 scope.go:117] "RemoveContainer" containerID="1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"
May 20 20:53:09.103236 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.103218    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c"} err="failed to get container status \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": rpc error: code = NotFound desc = could not find container \"1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c\": container with ID starting with 1777834670fbd8ac933680d4daa5381e5520eeba71300be36389ec418d46f68c not found: ID does not exist"
May 20 20:53:09.103289 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.103237    2554 scope.go:117] "RemoveContainer" containerID="fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"
May 20 20:53:09.103437 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.103421    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001"} err="failed to get container status \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": rpc error: code = NotFound desc = could not find container \"fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001\": container with ID starting with fd01c7129a10b178de835088c0b82038e9af4966939960307cbdd5bdc23f2001 not found: ID does not exist"
May 20 20:53:09.118243 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.118213    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:09.159215 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159184    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:09.159500 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159486    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy"
May 20 20:53:09.159542 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159503    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy"
May 20 20:53:09.159542 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159526    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-web"
May 20 20:53:09.159542 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159534    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-web"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159546    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="config-reloader"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159554    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="config-reloader"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159570    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="prometheus"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159577    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="prometheus"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159589    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="init-config-reloader"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159596    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="init-config-reloader"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159606    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb2590b-b2fc-43be-b843-ef368768da57" containerName="console"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159614    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb2590b-b2fc-43be-b843-ef368768da57" containerName="console"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159622    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="thanos-sidecar"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159627    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="thanos-sidecar"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159636    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0ac84a8-b65c-407d-894a-5cee269d8902" containerName="console"
May 20 20:53:09.159634 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159641    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ac84a8-b65c-407d-894a-5cee269d8902" containerName="console"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159647    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-thanos"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159653    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-thanos"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159717    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0ac84a8-b65c-407d-894a-5cee269d8902" containerName="console"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159727    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159736    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="thanos-sidecar"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159743    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-thanos"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159749    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="prometheus"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159755    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="kube-rbac-proxy-web"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159761    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" containerName="config-reloader"
May 20 20:53:09.160006 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.159767    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="5bb2590b-b2fc-43be-b843-ef368768da57" containerName="console"
May 20 20:53:09.163706 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.163689    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.167451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.167431    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 20 20:53:09.167451 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.167446    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 20 20:53:09.167621 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.167537    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 20 20:53:09.167621 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.167610    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6zjx4\""
May 20 20:53:09.167723 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.167536    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 20 20:53:09.168080 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168046    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 20 20:53:09.168189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168088    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 20 20:53:09.168189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168152    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dc0jspis56b46\""
May 20 20:53:09.168189 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168169    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 20 20:53:09.168333 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168263    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 20 20:53:09.168984 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.168964    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 20 20:53:09.170566 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.170464    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 20 20:53:09.173595 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.173576    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 20 20:53:09.174957 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.174942    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 20 20:53:09.179685 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.179664    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:09.300928 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.300902    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.300937    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.300955    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.300969    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrf9m\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-kube-api-access-qrf9m\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301098 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301030    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301127    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301190    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301207    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301226    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301267    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301293    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301354    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301396    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301468 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301433    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301632 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301632 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301499    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.301632 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.301516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402394 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402357    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402564 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402403    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402564 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402534    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402670 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402577    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402670 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402621    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402670 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402655    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402824 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402682    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402824 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402707    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrf9m\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-kube-api-access-qrf9m\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402824 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402739    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402824 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402765    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.402824 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402769    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402825    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402866    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402896    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402930    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402969    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.402999    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403051 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403037    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403092    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403288    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403440 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403320    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403646 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403570    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.403937 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.403914    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.405483 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.405455    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa63d453-8c3a-4970-a710-ff3515d112b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.405759 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.405731    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.405842 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.405787    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.406137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.406229    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.406318    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.407019    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407109 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.407026    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.407838 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.407821    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.408260 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.408232    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.408374 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.408355    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa63d453-8c3a-4970-a710-ff3515d112b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.409770 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.409749    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa63d453-8c3a-4970-a710-ff3515d112b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.415588 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.415570    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrf9m\" (UniqueName: \"kubernetes.io/projected/fa63d453-8c3a-4970-a710-ff3515d112b0-kube-api-access-qrf9m\") pod \"prometheus-k8s-0\" (UID: \"fa63d453-8c3a-4970-a710-ff3515d112b0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.473459 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.473404    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:09.613979 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:09.613856    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:53:09.616550 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:53:09.616521    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa63d453_8c3a_4970_a710_ff3515d112b0.slice/crio-a578e5e4ce7dbbff87d8b7b81aca321c6c1b1110abef1ce43a0f8934e6daad93 WatchSource:0}: Error finding container a578e5e4ce7dbbff87d8b7b81aca321c6c1b1110abef1ce43a0f8934e6daad93: Status 404 returned error can't find the container with id a578e5e4ce7dbbff87d8b7b81aca321c6c1b1110abef1ce43a0f8934e6daad93
May 20 20:53:10.034489 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:10.034385    2554 generic.go:358] "Generic (PLEG): container finished" podID="fa63d453-8c3a-4970-a710-ff3515d112b0" containerID="5a9c1d5ebeda9e39f208e980d7968481dcded0d97eb0218e87eb7b425940ded3" exitCode=0
May 20 20:53:10.034489 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:10.034472    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerDied","Data":"5a9c1d5ebeda9e39f208e980d7968481dcded0d97eb0218e87eb7b425940ded3"}
May 20 20:53:10.034700 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:10.034508    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"a578e5e4ce7dbbff87d8b7b81aca321c6c1b1110abef1ce43a0f8934e6daad93"}
May 20 20:53:10.142645 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:10.142613    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae" path="/var/lib/kubelet/pods/5cdc5fa2-9fd1-44c8-9434-1a6c837c4bae/volumes"
May 20 20:53:11.040252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040217    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"9d75c720aa36badb7360fea5fb972d0bda9ce2b0e6ea638a7658b9bda6ad93e9"}
May 20 20:53:11.040252 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040252    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"6570468837d41911009245fd9920a6a1169d25ef030f618ea2f2c73358c7c0a7"}
May 20 20:53:11.040478 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040263    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"39a7123d8619fe6ba985dfa305ef45e314b48541f904936dde6abb0cc1da90dc"}
May 20 20:53:11.040478 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040272    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"132bca15f5bc58e650f17b4ef2368c1f3937d7f29713304fbba2fdf2ab6e9a88"}
May 20 20:53:11.040478 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040279    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"2b3106e4981a9c1c337fe9de9d9e81fcebb0f8715cc6c7ef0fefa19edd5d68b3"}
May 20 20:53:11.040478 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.040287    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa63d453-8c3a-4970-a710-ff3515d112b0","Type":"ContainerStarted","Data":"439b978a9fb4f51288da6f587802a61d59aca403117d60f35f79021871c2fe57"}
May 20 20:53:11.078816 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:11.078755    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.078736434 podStartE2EDuration="2.078736434s" podCreationTimestamp="2026-05-20 20:53:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:53:11.077503209 +0000 UTC m=+275.470655024" watchObservedRunningTime="2026-05-20 20:53:11.078736434 +0000 UTC m=+275.471888256"
May 20 20:53:14.473878 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:14.473841    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:53:36.026767 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:36.026740    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:53:36.028123 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:36.028103    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:53:36.030017 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:36.029993    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:53:36.031251 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:36.031235    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:53:36.036240 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:53:36.036223    2554 kubelet.go:1628] "Image garbage collection succeeded"
May 20 20:54:09.473841 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:09.473800    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:54:09.489316 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:09.489273    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:54:10.221489 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:10.221452    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:54:59.624448 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.624404    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"]
May 20 20:54:59.627679 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.627657    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.631883 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.631860    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 20 20:54:59.633054 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.633027    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 20 20:54:59.633054 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.633046    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 20 20:54:59.633230 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.633036    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s9zdv\""
May 20 20:54:59.633230 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.633123    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 20:54:59.634410 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.634052    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 20:54:59.637102 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.637048    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"]
May 20 20:54:59.690801 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.690768    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lqxf\" (UniqueName: \"kubernetes.io/projected/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-kube-api-access-7lqxf\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.690987 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.690818    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.690987 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.690847    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.690987 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.690870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-manager-config\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.791521 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.791467    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.791727 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.791547    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.791727 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.791572    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-manager-config\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.791727 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.791609    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lqxf\" (UniqueName: \"kubernetes.io/projected/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-kube-api-access-7lqxf\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.792258 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.792238    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-manager-config\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.794038 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.794019    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.794219 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.794199    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.811685 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.811652    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lqxf\" (UniqueName: \"kubernetes.io/projected/8e0212df-bdf2-4298-b9c0-c49cc3f43e93-kube-api-access-7lqxf\") pod \"lws-controller-manager-d8d69f6f7-ff8wc\" (UID: \"8e0212df-bdf2-4298-b9c0-c49cc3f43e93\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:54:59.937227 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:54:59.937115    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:55:00.081029 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:55:00.080999    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0212df_bdf2_4298_b9c0_c49cc3f43e93.slice/crio-257cfcca507f5f8c5d06056daf0b0e3033c3a4a51a4ff79839a138eb4b1dc977 WatchSource:0}: Error finding container 257cfcca507f5f8c5d06056daf0b0e3033c3a4a51a4ff79839a138eb4b1dc977: Status 404 returned error can't find the container with id 257cfcca507f5f8c5d06056daf0b0e3033c3a4a51a4ff79839a138eb4b1dc977
May 20 20:55:00.082742 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:00.082725    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:55:00.086310 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:00.086287    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"]
May 20 20:55:00.348202 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:00.348169    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc" event={"ID":"8e0212df-bdf2-4298-b9c0-c49cc3f43e93","Type":"ContainerStarted","Data":"257cfcca507f5f8c5d06056daf0b0e3033c3a4a51a4ff79839a138eb4b1dc977"}
May 20 20:55:03.359536 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:03.359491    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc" event={"ID":"8e0212df-bdf2-4298-b9c0-c49cc3f43e93","Type":"ContainerStarted","Data":"e5535884b4a0f9e9f6c3fb1209c21c4adcae46f842d041d6d14acaccc16b79e0"}
May 20 20:55:03.360010 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:03.359609    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:55:03.403807 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:03.403754    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc" podStartSLOduration=1.486386022 podStartE2EDuration="4.403738335s" podCreationTimestamp="2026-05-20 20:54:59 +0000 UTC" firstStartedPulling="2026-05-20 20:55:00.082855086 +0000 UTC m=+384.476006886" lastFinishedPulling="2026-05-20 20:55:03.000207379 +0000 UTC m=+387.393359199" observedRunningTime="2026-05-20 20:55:03.403391504 +0000 UTC m=+387.796543327" watchObservedRunningTime="2026-05-20 20:55:03.403738335 +0000 UTC m=+387.796890189"
May 20 20:55:07.106135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.105369    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"]
May 20 20:55:07.110613 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.110584    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.114104 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.114055    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 20:55:07.114104 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.114094    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 20:55:07.114382 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.114367    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 20:55:07.114643 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.114630    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9czfm\""
May 20 20:55:07.114719 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.114633    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 20:55:07.126949 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.126925    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"]
May 20 20:55:07.245516 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.245475    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.245697 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.245600    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkw9\" (UniqueName: \"kubernetes.io/projected/4e57ad3b-fe23-47b6-8373-4041b460ec4a-kube-api-access-rmkw9\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.245768 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.245708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.346318 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.346283    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.346488 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.346350    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.346488 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.346384    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkw9\" (UniqueName: \"kubernetes.io/projected/4e57ad3b-fe23-47b6-8373-4041b460ec4a-kube-api-access-rmkw9\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.348679 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.348648    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.348679 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.348671    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e57ad3b-fe23-47b6-8373-4041b460ec4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.360858 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.360799    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkw9\" (UniqueName: \"kubernetes.io/projected/4e57ad3b-fe23-47b6-8373-4041b460ec4a-kube-api-access-rmkw9\") pod \"opendatahub-operator-controller-manager-6d5db49587-wp2hm\" (UID: \"4e57ad3b-fe23-47b6-8373-4041b460ec4a\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.420731 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.420700    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:07.563666 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:55:07.563632    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e57ad3b_fe23_47b6_8373_4041b460ec4a.slice/crio-4f16b039f753c39f9e19c76cf55bd5c4d4167979c46587951625dc30f72edaea WatchSource:0}: Error finding container 4f16b039f753c39f9e19c76cf55bd5c4d4167979c46587951625dc30f72edaea: Status 404 returned error can't find the container with id 4f16b039f753c39f9e19c76cf55bd5c4d4167979c46587951625dc30f72edaea
May 20 20:55:07.564437 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:07.564414    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"]
May 20 20:55:08.377712 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:08.377676    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm" event={"ID":"4e57ad3b-fe23-47b6-8373-4041b460ec4a","Type":"ContainerStarted","Data":"4f16b039f753c39f9e19c76cf55bd5c4d4167979c46587951625dc30f72edaea"}
May 20 20:55:10.386308 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:10.386221    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm" event={"ID":"4e57ad3b-fe23-47b6-8373-4041b460ec4a","Type":"ContainerStarted","Data":"31162a20a548b3afe844748f6c0ef9804af1384dd7996b07ca81ea33bf486f0f"}
May 20 20:55:10.386308 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:10.386290    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:10.416934 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:10.416880    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm" podStartSLOduration=0.881601369 podStartE2EDuration="3.41686022s" podCreationTimestamp="2026-05-20 20:55:07 +0000 UTC" firstStartedPulling="2026-05-20 20:55:07.566122984 +0000 UTC m=+391.959274786" lastFinishedPulling="2026-05-20 20:55:10.10138183 +0000 UTC m=+394.494533637" observedRunningTime="2026-05-20 20:55:10.414104302 +0000 UTC m=+394.807256121" watchObservedRunningTime="2026-05-20 20:55:10.41686022 +0000 UTC m=+394.810012043"
May 20 20:55:14.365152 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:14.365121    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-ff8wc"
May 20 20:55:21.391999 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:21.391969    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-wp2hm"
May 20 20:55:26.648153 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.648113    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"]
May 20 20:55:26.685291 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.685252    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"]
May 20 20:55:26.685434 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.685400    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.700335 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.700311    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 20:55:26.700474 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.700313    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 20 20:55:26.700566 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.700550    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m87ms\""
May 20 20:55:26.701219 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.701205    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 20:55:26.701264 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.701228    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 20:55:26.810267 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.810233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543475a9-e40d-487c-96d4-c917368594ef-tls-certs\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.810267 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.810274    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzltg\" (UniqueName: \"kubernetes.io/projected/543475a9-e40d-487c-96d4-c917368594ef-kube-api-access-zzltg\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.810485 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.810312    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543475a9-e40d-487c-96d4-c917368594ef-tmp\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.910893 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.910794    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543475a9-e40d-487c-96d4-c917368594ef-tls-certs\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.910893 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.910840    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzltg\" (UniqueName: \"kubernetes.io/projected/543475a9-e40d-487c-96d4-c917368594ef-kube-api-access-zzltg\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.911157 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.910970    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543475a9-e40d-487c-96d4-c917368594ef-tmp\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.913242 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.913216    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/543475a9-e40d-487c-96d4-c917368594ef-tmp\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.913348 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.913328    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543475a9-e40d-487c-96d4-c917368594ef-tls-certs\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.921595 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.921574    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzltg\" (UniqueName: \"kubernetes.io/projected/543475a9-e40d-487c-96d4-c917368594ef-kube-api-access-zzltg\") pod \"kube-auth-proxy-6f4c6b877d-b5cvr\" (UID: \"543475a9-e40d-487c-96d4-c917368594ef\") " pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:26.995551 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:26.995507    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"
May 20 20:55:27.137424 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:27.137396    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr"]
May 20 20:55:27.139805 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:55:27.139776    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543475a9_e40d_487c_96d4_c917368594ef.slice/crio-d02dd300307a769e078164af3145bacb233334bbda88d8cadd649dc2cd7b0751 WatchSource:0}: Error finding container d02dd300307a769e078164af3145bacb233334bbda88d8cadd649dc2cd7b0751: Status 404 returned error can't find the container with id d02dd300307a769e078164af3145bacb233334bbda88d8cadd649dc2cd7b0751
May 20 20:55:27.441140 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:27.441095    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr" event={"ID":"543475a9-e40d-487c-96d4-c917368594ef","Type":"ContainerStarted","Data":"d02dd300307a769e078164af3145bacb233334bbda88d8cadd649dc2cd7b0751"}
May 20 20:55:30.452160 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:30.452116    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr" event={"ID":"543475a9-e40d-487c-96d4-c917368594ef","Type":"ContainerStarted","Data":"9a29a36befc34be585133d0de29a106773df39f8b2fa0e37e1fbb1700b4e9868"}
May 20 20:55:30.475278 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:55:30.475223    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f4c6b877d-b5cvr" podStartSLOduration=1.2698232489999999 podStartE2EDuration="4.475210555s" podCreationTimestamp="2026-05-20 20:55:26 +0000 UTC" firstStartedPulling="2026-05-20 20:55:27.141618739 +0000 UTC m=+411.534770538" lastFinishedPulling="2026-05-20 20:55:30.347006028 +0000 UTC m=+414.740157844" observedRunningTime="2026-05-20 20:55:30.473698947 +0000 UTC m=+414.866850768" watchObservedRunningTime="2026-05-20 20:55:30.475210555 +0000 UTC m=+414.868362377"
May 20 20:57:08.183678 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.183639    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"]
May 20 20:57:08.187135 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.187117    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.190866 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.190843    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 20 20:57:08.191128 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.191106    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 20 20:57:08.192392 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.192367    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:57:08.192503 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.192421    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:57:08.192503 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.192421    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-25hd5\""
May 20 20:57:08.202574 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.202549    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"]
May 20 20:57:08.296896 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.296860    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sq62\" (UniqueName: \"kubernetes.io/projected/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-kube-api-access-6sq62\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.297092 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.296942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.297092 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.296966    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.397985 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.397951    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.397985 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.397993    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.398211 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.398036    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sq62\" (UniqueName: \"kubernetes.io/projected/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-kube-api-access-6sq62\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.398669 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.398641    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.400416 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.400392    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.407932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.407909    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sq62\" (UniqueName: \"kubernetes.io/projected/94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4-kube-api-access-6sq62\") pod \"kuadrant-console-plugin-6cb54b5c86-hm6th\" (UID: \"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.506302 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.506220    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"
May 20 20:57:08.644932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.644905    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th"]
May 20 20:57:08.649708 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:57:08.647614    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94c61d9c_6f1d_4b84_a747_8ec0e6b97ec4.slice/crio-03cfc7d3b703b9e22066e294b6ea2eb9bf729d00472a9a0139179702b10d0dd3 WatchSource:0}: Error finding container 03cfc7d3b703b9e22066e294b6ea2eb9bf729d00472a9a0139179702b10d0dd3: Status 404 returned error can't find the container with id 03cfc7d3b703b9e22066e294b6ea2eb9bf729d00472a9a0139179702b10d0dd3
May 20 20:57:08.776085 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:08.775992    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th" event={"ID":"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4","Type":"ContainerStarted","Data":"03cfc7d3b703b9e22066e294b6ea2eb9bf729d00472a9a0139179702b10d0dd3"}
May 20 20:57:31.873384 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:31.873348    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th" event={"ID":"94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4","Type":"ContainerStarted","Data":"78d183c6476a5934dd09fcd066e34c017bf3e7ab96cb4b151b90b04d1dd65410"}
May 20 20:57:31.898770 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:31.898717    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hm6th" podStartSLOduration=1.705585865 podStartE2EDuration="23.898703495s" podCreationTimestamp="2026-05-20 20:57:08 +0000 UTC" firstStartedPulling="2026-05-20 20:57:08.65078517 +0000 UTC m=+513.043936972" lastFinishedPulling="2026-05-20 20:57:30.843902799 +0000 UTC m=+535.237054602" observedRunningTime="2026-05-20 20:57:31.896282814 +0000 UTC m=+536.289434636" watchObservedRunningTime="2026-05-20 20:57:31.898703495 +0000 UTC m=+536.291855334"
May 20 20:57:52.685413 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.685377    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:57:52.712279 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.712241    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:57:52.712430 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.712325    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.715739 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.715714    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 20 20:57:52.785800 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.785766    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:57:52.792177 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.792145    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.792313 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.792203    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4jr\" (UniqueName: \"kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.893476 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.893442    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.893642 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.893481    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4jr\" (UniqueName: \"kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.894140 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.894117    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:52.908876 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:52.908845    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4jr\" (UniqueName: \"kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr\") pod \"limitador-limitador-7d549b5b-72h6p\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") " pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:53.022843 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.022758    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:53.158977 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.158954    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:57:53.161367 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:57:53.161338    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31478b1_8fbf_4f3f_8bcf_2f638b7471ae.slice/crio-cd86ab616b85d7983bb437a00bcb89739532fea28e2f7a30c66cfba59423cded WatchSource:0}: Error finding container cd86ab616b85d7983bb437a00bcb89739532fea28e2f7a30c66cfba59423cded: Status 404 returned error can't find the container with id cd86ab616b85d7983bb437a00bcb89739532fea28e2f7a30c66cfba59423cded
May 20 20:57:53.862456 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.862420    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:57:53.866343 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.866317    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:57:53.870754 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.870540    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5mcs2\""
May 20 20:57:53.877753 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.877147    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:57:53.902495 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.902409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqlsp\" (UniqueName: \"kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp\") pod \"authorino-7498df8756-wxd44\" (UID: \"503016ea-25b3-4504-b891-92abec44e0ad\") " pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:57:53.949160 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:53.949103    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" event={"ID":"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae","Type":"ContainerStarted","Data":"cd86ab616b85d7983bb437a00bcb89739532fea28e2f7a30c66cfba59423cded"}
May 20 20:57:54.004250 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:54.003781    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqlsp\" (UniqueName: \"kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp\") pod \"authorino-7498df8756-wxd44\" (UID: \"503016ea-25b3-4504-b891-92abec44e0ad\") " pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:57:54.022623 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:54.022563    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqlsp\" (UniqueName: \"kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp\") pod \"authorino-7498df8756-wxd44\" (UID: \"503016ea-25b3-4504-b891-92abec44e0ad\") " pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:57:54.181030 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:54.180728    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:57:54.346249 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:54.346164    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:57:54.348954 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:57:54.348923    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod503016ea_25b3_4504_b891_92abec44e0ad.slice/crio-84c3c490a181068736dc55063b8a1921c15815379c5b912b18d59a68ff23f6c9 WatchSource:0}: Error finding container 84c3c490a181068736dc55063b8a1921c15815379c5b912b18d59a68ff23f6c9: Status 404 returned error can't find the container with id 84c3c490a181068736dc55063b8a1921c15815379c5b912b18d59a68ff23f6c9
May 20 20:57:54.955129 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:54.955089    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wxd44" event={"ID":"503016ea-25b3-4504-b891-92abec44e0ad","Type":"ContainerStarted","Data":"84c3c490a181068736dc55063b8a1921c15815379c5b912b18d59a68ff23f6c9"}
May 20 20:57:56.963594 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:56.963555    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" event={"ID":"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae","Type":"ContainerStarted","Data":"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"}
May 20 20:57:56.964043 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:56.963687    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:57:56.984809 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:56.984757    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" podStartSLOduration=2.22362153 podStartE2EDuration="4.984741409s" podCreationTimestamp="2026-05-20 20:57:52 +0000 UTC" firstStartedPulling="2026-05-20 20:57:53.162995634 +0000 UTC m=+557.556147434" lastFinishedPulling="2026-05-20 20:57:55.924115501 +0000 UTC m=+560.317267313" observedRunningTime="2026-05-20 20:57:56.983488308 +0000 UTC m=+561.376640131" watchObservedRunningTime="2026-05-20 20:57:56.984741409 +0000 UTC m=+561.377893232"
May 20 20:57:58.971300 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:58.971259    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wxd44" event={"ID":"503016ea-25b3-4504-b891-92abec44e0ad","Type":"ContainerStarted","Data":"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"}
May 20 20:57:58.992615 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:57:58.992543    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-wxd44" podStartSLOduration=2.225097656 podStartE2EDuration="5.992529755s" podCreationTimestamp="2026-05-20 20:57:53 +0000 UTC" firstStartedPulling="2026-05-20 20:57:54.350483782 +0000 UTC m=+558.743635583" lastFinishedPulling="2026-05-20 20:57:58.117915864 +0000 UTC m=+562.511067682" observedRunningTime="2026-05-20 20:57:58.99165178 +0000 UTC m=+563.384803602" watchObservedRunningTime="2026-05-20 20:57:58.992529755 +0000 UTC m=+563.385681577"
May 20 20:58:07.424610 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:07.424572    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:58:07.425172 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:07.424798    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" podUID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" containerName="limitador" containerID="cri-o://2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526" gracePeriod=30
May 20 20:58:07.425548 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:07.425409    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:58:07.963828 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:07.963803    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:58:08.003170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.003060    2554 generic.go:358] "Generic (PLEG): container finished" podID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" containerID="2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526" exitCode=0
May 20 20:58:08.003170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.003106    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" event={"ID":"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae","Type":"ContainerDied","Data":"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"}
May 20 20:58:08.003170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.003142    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p"
May 20 20:58:08.003170 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.003161    2554 scope.go:117] "RemoveContainer" containerID="2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"
May 20 20:58:08.003481 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.003149    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-72h6p" event={"ID":"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae","Type":"ContainerDied","Data":"cd86ab616b85d7983bb437a00bcb89739532fea28e2f7a30c66cfba59423cded"}
May 20 20:58:08.012568 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.012550    2554 scope.go:117] "RemoveContainer" containerID="2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"
May 20 20:58:08.012829 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:58:08.012810    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526\": container with ID starting with 2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526 not found: ID does not exist" containerID="2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"
May 20 20:58:08.012886 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.012839    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526"} err="failed to get container status \"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526\": rpc error: code = NotFound desc = could not find container \"2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526\": container with ID starting with 2f7745a1d4681943c50e5930b7b3ff86f9248d55e099f43eab9ff6602aad6526 not found: ID does not exist"
May 20 20:58:08.033519 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.033496    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file\") pod \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") "
May 20 20:58:08.033628 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.033558    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs4jr\" (UniqueName: \"kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr\") pod \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\" (UID: \"f31478b1-8fbf-4f3f-8bcf-2f638b7471ae\") "
May 20 20:58:08.033887 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.033862    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file" (OuterVolumeSpecName: "config-file") pod "f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" (UID: "f31478b1-8fbf-4f3f-8bcf-2f638b7471ae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:58:08.035854 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.035829    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr" (OuterVolumeSpecName: "kube-api-access-fs4jr") pod "f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" (UID: "f31478b1-8fbf-4f3f-8bcf-2f638b7471ae"). InnerVolumeSpecName "kube-api-access-fs4jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:58:08.134767 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.134728    2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-config-file\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:58:08.134767 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.134760    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs4jr\" (UniqueName: \"kubernetes.io/projected/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae-kube-api-access-fs4jr\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:58:08.334041 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.334005    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:58:08.345186 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.345158    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-72h6p"]
May 20 20:58:08.655940 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.655859    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mht44"]
May 20 20:58:08.656446 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.656426    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" containerName="limitador"
May 20 20:58:08.656556 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.656450    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" containerName="limitador"
May 20 20:58:08.656556 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.656532    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" containerName="limitador"
May 20 20:58:08.660820 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.660801    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.664591 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.664571    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 20 20:58:08.664894 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.664879    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vz7b8\""
May 20 20:58:08.671139 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.671118    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mht44"]
May 20 20:58:08.741202 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.741165    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8336f958-87d2-41b4-bc9f-855ecc13f170-data\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.741372 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.741212    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjdht\" (UniqueName: \"kubernetes.io/projected/8336f958-87d2-41b4-bc9f-855ecc13f170-kube-api-access-hjdht\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.842016 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.841973    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjdht\" (UniqueName: \"kubernetes.io/projected/8336f958-87d2-41b4-bc9f-855ecc13f170-kube-api-access-hjdht\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.842224 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.842094    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8336f958-87d2-41b4-bc9f-855ecc13f170-data\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.842951 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.842921    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8336f958-87d2-41b4-bc9f-855ecc13f170-data\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.854785 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.854756    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjdht\" (UniqueName: \"kubernetes.io/projected/8336f958-87d2-41b4-bc9f-855ecc13f170-kube-api-access-hjdht\") pod \"postgres-68c4fbbd6f-mht44\" (UID: \"8336f958-87d2-41b4-bc9f-855ecc13f170\") " pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:08.971850 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:08.971755    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:09.103724 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:09.103696    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mht44"]
May 20 20:58:09.104940 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:58:09.104905    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8336f958_87d2_41b4_bc9f_855ecc13f170.slice/crio-afb479e84b74bc87517facc7efd86c96a5aac865aca3351dd3ca1f28a477d9b1 WatchSource:0}: Error finding container afb479e84b74bc87517facc7efd86c96a5aac865aca3351dd3ca1f28a477d9b1: Status 404 returned error can't find the container with id afb479e84b74bc87517facc7efd86c96a5aac865aca3351dd3ca1f28a477d9b1
May 20 20:58:10.014259 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:10.014209    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mht44" event={"ID":"8336f958-87d2-41b4-bc9f-855ecc13f170","Type":"ContainerStarted","Data":"afb479e84b74bc87517facc7efd86c96a5aac865aca3351dd3ca1f28a477d9b1"}
May 20 20:58:10.143971 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:10.143931    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f31478b1-8fbf-4f3f-8bcf-2f638b7471ae" path="/var/lib/kubelet/pods/f31478b1-8fbf-4f3f-8bcf-2f638b7471ae/volumes"
May 20 20:58:14.030964 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:14.030927    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mht44" event={"ID":"8336f958-87d2-41b4-bc9f-855ecc13f170","Type":"ContainerStarted","Data":"b50a65c3137476d1a564ef1981e0fbb21ba29e884b9217c59256db556f4e6171"}
May 20 20:58:14.031408 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:14.031003    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:14.055276 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:14.055212    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-mht44" podStartSLOduration=1.241585436 podStartE2EDuration="6.05519699s" podCreationTimestamp="2026-05-20 20:58:08 +0000 UTC" firstStartedPulling="2026-05-20 20:58:09.106444165 +0000 UTC m=+573.499595967" lastFinishedPulling="2026-05-20 20:58:13.920055718 +0000 UTC m=+578.313207521" observedRunningTime="2026-05-20 20:58:14.053903816 +0000 UTC m=+578.447055639" watchObservedRunningTime="2026-05-20 20:58:14.05519699 +0000 UTC m=+578.448348812"
May 20 20:58:20.063060 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:20.063030    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-mht44"
May 20 20:58:36.032839 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.032799    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 20:58:36.037976 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.037953    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 20:58:36.041358 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.041338    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-2m56h\""
May 20 20:58:36.041645 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.041384    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 20:58:36.042774 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.042755    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 20:58:36.050474 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.050447    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 20:58:36.058548 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.058527    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:58:36.059625 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.059603    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 20:58:36.062675 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.062657    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:58:36.063487 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.063465    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 20:58:36.090284 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.090262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwv6\" (UniqueName: \"kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6\") pod \"keycloak-operator-5c4df598dd-f5x44\" (UID: \"2445cd12-9a4f-43c0-b11d-91954b025ac1\") " pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 20:58:36.190737 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.190709    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwv6\" (UniqueName: \"kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6\") pod \"keycloak-operator-5c4df598dd-f5x44\" (UID: \"2445cd12-9a4f-43c0-b11d-91954b025ac1\") " pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 20:58:36.202596 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.202559    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwv6\" (UniqueName: \"kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6\") pod \"keycloak-operator-5c4df598dd-f5x44\" (UID: \"2445cd12-9a4f-43c0-b11d-91954b025ac1\") " pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 20:58:36.358347 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.358300    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 20:58:36.489358 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:36.489336    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 20:58:36.491137 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:58:36.491107    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2445cd12_9a4f_43c0_b11d_91954b025ac1.slice/crio-659834ba2b8b6412ccef83a736687488f18ace6294f9714119779686beb160ab WatchSource:0}: Error finding container 659834ba2b8b6412ccef83a736687488f18ace6294f9714119779686beb160ab: Status 404 returned error can't find the container with id 659834ba2b8b6412ccef83a736687488f18ace6294f9714119779686beb160ab
May 20 20:58:37.110041 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:37.109986    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" event={"ID":"2445cd12-9a4f-43c0-b11d-91954b025ac1","Type":"ContainerStarted","Data":"659834ba2b8b6412ccef83a736687488f18ace6294f9714119779686beb160ab"}
May 20 20:58:43.130936 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:43.130895    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" event={"ID":"2445cd12-9a4f-43c0-b11d-91954b025ac1","Type":"ContainerStarted","Data":"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"}
May 20 20:58:43.154562 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:58:43.154515    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" podStartSLOduration=1.5683020170000002 podStartE2EDuration="7.154502736s" podCreationTimestamp="2026-05-20 20:58:36 +0000 UTC" firstStartedPulling="2026-05-20 20:58:36.492594397 +0000 UTC m=+600.885746197" lastFinishedPulling="2026-05-20 20:58:42.078795104 +0000 UTC m=+606.471946916" observedRunningTime="2026-05-20 20:58:43.152284672 +0000 UTC m=+607.545436494" watchObservedRunningTime="2026-05-20 20:58:43.154502736 +0000 UTC m=+607.547654557"
May 20 20:59:21.079675 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.079639    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:21.081873 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.081856    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:21.096275 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.096234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7455\" (UniqueName: \"kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455\") pod \"authorino-8b475cf9f-cg2n9\" (UID: \"1d24d136-869b-4373-8df4-b60072dabce5\") " pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:21.098354 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.098330    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:21.197651 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.197619    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7455\" (UniqueName: \"kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455\") pod \"authorino-8b475cf9f-cg2n9\" (UID: \"1d24d136-869b-4373-8df4-b60072dabce5\") " pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:21.209496 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.209467    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7455\" (UniqueName: \"kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455\") pod \"authorino-8b475cf9f-cg2n9\" (UID: \"1d24d136-869b-4373-8df4-b60072dabce5\") " pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:21.333391 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.333282    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:21.333914 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.333892    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:21.482543 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.482478    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:21.484860 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:59:21.484828    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d24d136_869b_4373_8df4_b60072dabce5.slice/crio-c6bb275376242b7805c96efd7090a015a3cf00d3ae92b8472c451b4a016436f5 WatchSource:0}: Error finding container c6bb275376242b7805c96efd7090a015a3cf00d3ae92b8472c451b4a016436f5: Status 404 returned error can't find the container with id c6bb275376242b7805c96efd7090a015a3cf00d3ae92b8472c451b4a016436f5
May 20 20:59:21.685342 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.685267    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 20:59:21.687997 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.687980    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.696610 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.696582    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 20 20:59:21.698774 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.698751    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 20:59:21.803961 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.803925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.803961 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.803965    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhzb\" (UniqueName: \"kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.904525 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.904481    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.904525 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.904526    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhzb\" (UniqueName: \"kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.906947 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.906923    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.915204 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.915178    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhzb\" (UniqueName: \"kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb\") pod \"authorino-8c6cb6d96-2lk6p\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") " pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:21.998355 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:21.998329    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 20:59:22.136838 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.136810    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 20:59:22.137701 ip-10-0-138-50 kubenswrapper[2554]: W0520 20:59:22.137675    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1de4f832_29da_43cb_a573_be6322bf939c.slice/crio-0b2457c90df492c23d2ec9a5a86d3a5b22ffeb8aead32aac1cff054c57753033 WatchSource:0}: Error finding container 0b2457c90df492c23d2ec9a5a86d3a5b22ffeb8aead32aac1cff054c57753033: Status 404 returned error can't find the container with id 0b2457c90df492c23d2ec9a5a86d3a5b22ffeb8aead32aac1cff054c57753033
May 20 20:59:22.259932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.259830    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" event={"ID":"1d24d136-869b-4373-8df4-b60072dabce5","Type":"ContainerStarted","Data":"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"}
May 20 20:59:22.259932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.259884    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" event={"ID":"1d24d136-869b-4373-8df4-b60072dabce5","Type":"ContainerStarted","Data":"c6bb275376242b7805c96efd7090a015a3cf00d3ae92b8472c451b4a016436f5"}
May 20 20:59:22.259932 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.259890    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" podUID="1d24d136-869b-4373-8df4-b60072dabce5" containerName="authorino" containerID="cri-o://3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b" gracePeriod=30
May 20 20:59:22.260988 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.260959    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" event={"ID":"1de4f832-29da-43cb-a573-be6322bf939c","Type":"ContainerStarted","Data":"0b2457c90df492c23d2ec9a5a86d3a5b22ffeb8aead32aac1cff054c57753033"}
May 20 20:59:22.284904 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.284853    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" podStartSLOduration=0.827190201 podStartE2EDuration="1.284836826s" podCreationTimestamp="2026-05-20 20:59:21 +0000 UTC" firstStartedPulling="2026-05-20 20:59:21.48612147 +0000 UTC m=+645.879273269" lastFinishedPulling="2026-05-20 20:59:21.94376809 +0000 UTC m=+646.336919894" observedRunningTime="2026-05-20 20:59:22.28437936 +0000 UTC m=+646.677531194" watchObservedRunningTime="2026-05-20 20:59:22.284836826 +0000 UTC m=+646.677988660"
May 20 20:59:22.502945 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.502920    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:22.608307 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.608266    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7455\" (UniqueName: \"kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455\") pod \"1d24d136-869b-4373-8df4-b60072dabce5\" (UID: \"1d24d136-869b-4373-8df4-b60072dabce5\") "
May 20 20:59:22.610663 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.610627    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455" (OuterVolumeSpecName: "kube-api-access-s7455") pod "1d24d136-869b-4373-8df4-b60072dabce5" (UID: "1d24d136-869b-4373-8df4-b60072dabce5"). InnerVolumeSpecName "kube-api-access-s7455". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:22.709128 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:22.709056    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7455\" (UniqueName: \"kubernetes.io/projected/1d24d136-869b-4373-8df4-b60072dabce5-kube-api-access-s7455\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:59:23.265709 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.265664    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" event={"ID":"1de4f832-29da-43cb-a573-be6322bf939c","Type":"ContainerStarted","Data":"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"}
May 20 20:59:23.266734 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.266710    2554 generic.go:358] "Generic (PLEG): container finished" podID="1d24d136-869b-4373-8df4-b60072dabce5" containerID="3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b" exitCode=0
May 20 20:59:23.266832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.266748    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cg2n9"
May 20 20:59:23.266832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.266756    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" event={"ID":"1d24d136-869b-4373-8df4-b60072dabce5","Type":"ContainerDied","Data":"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"}
May 20 20:59:23.266832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.266777    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cg2n9" event={"ID":"1d24d136-869b-4373-8df4-b60072dabce5","Type":"ContainerDied","Data":"c6bb275376242b7805c96efd7090a015a3cf00d3ae92b8472c451b4a016436f5"}
May 20 20:59:23.266832 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.266791    2554 scope.go:117] "RemoveContainer" containerID="3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"
May 20 20:59:23.275301 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.275279    2554 scope.go:117] "RemoveContainer" containerID="3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"
May 20 20:59:23.275555 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:59:23.275534    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b\": container with ID starting with 3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b not found: ID does not exist" containerID="3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"
May 20 20:59:23.275612 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.275566    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b"} err="failed to get container status \"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b\": rpc error: code = NotFound desc = could not find container \"3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b\": container with ID starting with 3f065ff0c65a0fb3f31e738a87696fab6b0cf2e1715efa7476f8b7b7a42e981b not found: ID does not exist"
May 20 20:59:23.292537 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.292494    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" podStartSLOduration=1.907938432 podStartE2EDuration="2.292482331s" podCreationTimestamp="2026-05-20 20:59:21 +0000 UTC" firstStartedPulling="2026-05-20 20:59:22.139093443 +0000 UTC m=+646.532245244" lastFinishedPulling="2026-05-20 20:59:22.523637331 +0000 UTC m=+646.916789143" observedRunningTime="2026-05-20 20:59:23.291896372 +0000 UTC m=+647.685048194" watchObservedRunningTime="2026-05-20 20:59:23.292482331 +0000 UTC m=+647.685634154"
May 20 20:59:23.313905 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.313869    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:23.318020 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.317990    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cg2n9"]
May 20 20:59:23.328257 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.328228    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:59:23.328439 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.328419    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-wxd44" podUID="503016ea-25b3-4504-b891-92abec44e0ad" containerName="authorino" containerID="cri-o://a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208" gracePeriod=30
May 20 20:59:23.577791 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.577768    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:59:23.618957 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.618914    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqlsp\" (UniqueName: \"kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp\") pod \"503016ea-25b3-4504-b891-92abec44e0ad\" (UID: \"503016ea-25b3-4504-b891-92abec44e0ad\") "
May 20 20:59:23.621215 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.621187    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp" (OuterVolumeSpecName: "kube-api-access-bqlsp") pod "503016ea-25b3-4504-b891-92abec44e0ad" (UID: "503016ea-25b3-4504-b891-92abec44e0ad"). InnerVolumeSpecName "kube-api-access-bqlsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:23.720147 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:23.720115    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqlsp\" (UniqueName: \"kubernetes.io/projected/503016ea-25b3-4504-b891-92abec44e0ad-kube-api-access-bqlsp\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 20:59:24.141755 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.141720    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d24d136-869b-4373-8df4-b60072dabce5" path="/var/lib/kubelet/pods/1d24d136-869b-4373-8df4-b60072dabce5/volumes"
May 20 20:59:24.271781 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.271738    2554 generic.go:358] "Generic (PLEG): container finished" podID="503016ea-25b3-4504-b891-92abec44e0ad" containerID="a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208" exitCode=0
May 20 20:59:24.272247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.271790    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wxd44"
May 20 20:59:24.272247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.271823    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wxd44" event={"ID":"503016ea-25b3-4504-b891-92abec44e0ad","Type":"ContainerDied","Data":"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"}
May 20 20:59:24.272247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.271863    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wxd44" event={"ID":"503016ea-25b3-4504-b891-92abec44e0ad","Type":"ContainerDied","Data":"84c3c490a181068736dc55063b8a1921c15815379c5b912b18d59a68ff23f6c9"}
May 20 20:59:24.272247 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.271885    2554 scope.go:117] "RemoveContainer" containerID="a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"
May 20 20:59:24.279704 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.279683    2554 scope.go:117] "RemoveContainer" containerID="a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"
May 20 20:59:24.279955 ip-10-0-138-50 kubenswrapper[2554]: E0520 20:59:24.279935    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208\": container with ID starting with a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208 not found: ID does not exist" containerID="a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"
May 20 20:59:24.280037 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.279964    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208"} err="failed to get container status \"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208\": rpc error: code = NotFound desc = could not find container \"a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208\": container with ID starting with a9e1af1c6c9bbfe030f9817bba49f1bf3d0cb2b1ede65d69f23b918864eef208 not found: ID does not exist"
May 20 20:59:24.296336 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.296303    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:59:24.301648 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:24.301625    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-wxd44"]
May 20 20:59:26.142345 ip-10-0-138-50 kubenswrapper[2554]: I0520 20:59:26.142312    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="503016ea-25b3-4504-b891-92abec44e0ad" path="/var/lib/kubelet/pods/503016ea-25b3-4504-b891-92abec44e0ad/volumes"
May 20 21:00:42.586046 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.586001    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 21:00:42.586643 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.586320    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" podUID="1de4f832-29da-43cb-a573-be6322bf939c" containerName="authorino" containerID="cri-o://3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920" gracePeriod=30
May 20 21:00:42.836795 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.836731    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 21:00:42.912085 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.912024    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert\") pod \"1de4f832-29da-43cb-a573-be6322bf939c\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") "
May 20 21:00:42.912251 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.912183    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzhzb\" (UniqueName: \"kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb\") pod \"1de4f832-29da-43cb-a573-be6322bf939c\" (UID: \"1de4f832-29da-43cb-a573-be6322bf939c\") "
May 20 21:00:42.914045 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.914013    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb" (OuterVolumeSpecName: "kube-api-access-mzhzb") pod "1de4f832-29da-43cb-a573-be6322bf939c" (UID: "1de4f832-29da-43cb-a573-be6322bf939c"). InnerVolumeSpecName "kube-api-access-mzhzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:00:42.921662 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:42.921638    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1de4f832-29da-43cb-a573-be6322bf939c" (UID: "1de4f832-29da-43cb-a573-be6322bf939c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:00:43.012981 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.012947    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzhzb\" (UniqueName: \"kubernetes.io/projected/1de4f832-29da-43cb-a573-be6322bf939c-kube-api-access-mzhzb\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 21:00:43.012981 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.012977    2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1de4f832-29da-43cb-a573-be6322bf939c-tls-cert\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 21:00:43.550372 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.550337    2554 generic.go:358] "Generic (PLEG): container finished" podID="1de4f832-29da-43cb-a573-be6322bf939c" containerID="3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920" exitCode=0
May 20 21:00:43.550545 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.550387    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p"
May 20 21:00:43.550545 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.550418    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" event={"ID":"1de4f832-29da-43cb-a573-be6322bf939c","Type":"ContainerDied","Data":"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"}
May 20 21:00:43.550545 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.550456    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8c6cb6d96-2lk6p" event={"ID":"1de4f832-29da-43cb-a573-be6322bf939c","Type":"ContainerDied","Data":"0b2457c90df492c23d2ec9a5a86d3a5b22ffeb8aead32aac1cff054c57753033"}
May 20 21:00:43.550545 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.550472    2554 scope.go:117] "RemoveContainer" containerID="3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"
May 20 21:00:43.563889 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.563867    2554 scope.go:117] "RemoveContainer" containerID="3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"
May 20 21:00:43.564180 ip-10-0-138-50 kubenswrapper[2554]: E0520 21:00:43.564162    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920\": container with ID starting with 3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920 not found: ID does not exist" containerID="3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"
May 20 21:00:43.564235 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.564187    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920"} err="failed to get container status \"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920\": rpc error: code = NotFound desc = could not find container \"3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920\": container with ID starting with 3a7a52235556b7c069683bf948ae9b771ddfc7a9887b2d60eea68f21f1a48920 not found: ID does not exist"
May 20 21:00:43.576985 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.576957    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 21:00:43.583605 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:43.583579    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8c6cb6d96-2lk6p"]
May 20 21:00:44.140734 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:00:44.140702    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de4f832-29da-43cb-a573-be6322bf939c" path="/var/lib/kubelet/pods/1de4f832-29da-43cb-a573-be6322bf939c/volumes"
May 20 21:01:10.299102 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299051    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"]
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299429    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de4f832-29da-43cb-a573-be6322bf939c" containerName="authorino"
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299444    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de4f832-29da-43cb-a573-be6322bf939c" containerName="authorino"
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299453    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503016ea-25b3-4504-b891-92abec44e0ad" containerName="authorino"
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299458    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="503016ea-25b3-4504-b891-92abec44e0ad" containerName="authorino"
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299469    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d24d136-869b-4373-8df4-b60072dabce5" containerName="authorino"
May 20 21:01:10.299476 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299475    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d24d136-869b-4373-8df4-b60072dabce5" containerName="authorino"
May 20 21:01:10.299656 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299526    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="503016ea-25b3-4504-b891-92abec44e0ad" containerName="authorino"
May 20 21:01:10.299656 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299534    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="1de4f832-29da-43cb-a573-be6322bf939c" containerName="authorino"
May 20 21:01:10.299656 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.299543    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d24d136-869b-4373-8df4-b60072dabce5" containerName="authorino"
May 20 21:01:10.302452 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.302435    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.306275 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.306255    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 21:01:10.306371 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.306297    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 21:01:10.307662 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.307639    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j2z8q\""
May 20 21:01:10.307662 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.307654    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 20 21:01:10.314375 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.314347    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"]
May 20 21:01:10.349791 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.349756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3b6a565-6dce-4351-8432-10a219fbe68f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.350015 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.349797    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8cl\" (UniqueName: \"kubernetes.io/projected/b3b6a565-6dce-4351-8432-10a219fbe68f-kube-api-access-bf8cl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.350015 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.349885    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.350015 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.349922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.350015 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.349972    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.350015 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.350005    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450616 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450581    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450789 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450624    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450789 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450747    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3b6a565-6dce-4351-8432-10a219fbe68f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450880 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450789    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8cl\" (UniqueName: \"kubernetes.io/projected/b3b6a565-6dce-4351-8432-10a219fbe68f-kube-api-access-bf8cl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450880 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450857    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.450979 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.450953    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.451083 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.451049    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.451165 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.451134    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.451334 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.451311    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.452825 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.452805    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3b6a565-6dce-4351-8432-10a219fbe68f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.453185 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.453169    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3b6a565-6dce-4351-8432-10a219fbe68f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.463812 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.463790    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8cl\" (UniqueName: \"kubernetes.io/projected/b3b6a565-6dce-4351-8432-10a219fbe68f-kube-api-access-bf8cl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd\" (UID: \"b3b6a565-6dce-4351-8432-10a219fbe68f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.613329 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.613300    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:10.749975 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.749948    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"]
May 20 21:01:10.751670 ip-10-0-138-50 kubenswrapper[2554]: W0520 21:01:10.751640    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b6a565_6dce_4351_8432_10a219fbe68f.slice/crio-cafc1c86bef674580c26d76a478835000e93fb355485dd7981706e21fe280fbb WatchSource:0}: Error finding container cafc1c86bef674580c26d76a478835000e93fb355485dd7981706e21fe280fbb: Status 404 returned error can't find the container with id cafc1c86bef674580c26d76a478835000e93fb355485dd7981706e21fe280fbb
May 20 21:01:10.753400 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:10.753384    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:01:11.641075 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:11.641007    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd" event={"ID":"b3b6a565-6dce-4351-8432-10a219fbe68f","Type":"ContainerStarted","Data":"cafc1c86bef674580c26d76a478835000e93fb355485dd7981706e21fe280fbb"}
May 20 21:01:16.661951 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:16.661913    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd" event={"ID":"b3b6a565-6dce-4351-8432-10a219fbe68f","Type":"ContainerStarted","Data":"cbe6058db97bf4817368c8b1cbbf876648bb88093f65cea12e3f117870e2ec32"}
May 20 21:01:21.679377 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:21.679343    2554 generic.go:358] "Generic (PLEG): container finished" podID="b3b6a565-6dce-4351-8432-10a219fbe68f" containerID="cbe6058db97bf4817368c8b1cbbf876648bb88093f65cea12e3f117870e2ec32" exitCode=0
May 20 21:01:21.679770 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:21.679411    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd" event={"ID":"b3b6a565-6dce-4351-8432-10a219fbe68f","Type":"ContainerDied","Data":"cbe6058db97bf4817368c8b1cbbf876648bb88093f65cea12e3f117870e2ec32"}
May 20 21:01:23.688506 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:23.688472    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd" event={"ID":"b3b6a565-6dce-4351-8432-10a219fbe68f","Type":"ContainerStarted","Data":"7a20d6704a1f5cfbd6c4d81e3d28a523e2cd397e77da2326369da1205e516d10"}
May 20 21:01:23.688928 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:23.688698    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:01:23.715975 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:23.715930    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd" podStartSLOduration=1.688894362 podStartE2EDuration="13.715915503s" podCreationTimestamp="2026-05-20 21:01:10 +0000 UTC" firstStartedPulling="2026-05-20 21:01:10.753509579 +0000 UTC m=+755.146661378" lastFinishedPulling="2026-05-20 21:01:22.780530719 +0000 UTC m=+767.173682519" observedRunningTime="2026-05-20 21:01:23.715483507 +0000 UTC m=+768.108635329" watchObservedRunningTime="2026-05-20 21:01:23.715915503 +0000 UTC m=+768.109067324"
May 20 21:01:34.704460 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:01:34.704429    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd"
May 20 21:02:12.113251 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.113159    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"]
May 20 21:02:12.115877 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.115856    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.118670 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.118649    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 20 21:02:12.125947 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.125923    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"]
May 20 21:02:12.209294 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.209294 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209296    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.209514 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209319    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.209514 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.209514 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209437    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bbf73fc-2992-42c6-8844-1a7871831ff7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.209514 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.209467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9j25\" (UniqueName: \"kubernetes.io/projected/4bbf73fc-2992-42c6-8844-1a7871831ff7-kube-api-access-v9j25\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.310841 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.310801    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311036 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.310849    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bbf73fc-2992-42c6-8844-1a7871831ff7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311036 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.310892    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9j25\" (UniqueName: \"kubernetes.io/projected/4bbf73fc-2992-42c6-8844-1a7871831ff7-kube-api-access-v9j25\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311036 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.310960    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311036 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.310988    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311036 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.311012    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311364 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.311279    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311364 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.311304    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.311475 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.311417    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.313266 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.313242    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bbf73fc-2992-42c6-8844-1a7871831ff7-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.313457 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.313443    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bbf73fc-2992-42c6-8844-1a7871831ff7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.320014 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.319991    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9j25\" (UniqueName: \"kubernetes.io/projected/4bbf73fc-2992-42c6-8844-1a7871831ff7-kube-api-access-v9j25\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-2wp99\" (UID: \"4bbf73fc-2992-42c6-8844-1a7871831ff7\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.424925 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.424844    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:12.561544 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.561516    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"]
May 20 21:02:12.563081 ip-10-0-138-50 kubenswrapper[2554]: W0520 21:02:12.563042    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbf73fc_2992_42c6_8844_1a7871831ff7.slice/crio-2118418fc3430c6aa72999bfe1707d5d77a921e127a247414dcedfbf4292ac5e WatchSource:0}: Error finding container 2118418fc3430c6aa72999bfe1707d5d77a921e127a247414dcedfbf4292ac5e: Status 404 returned error can't find the container with id 2118418fc3430c6aa72999bfe1707d5d77a921e127a247414dcedfbf4292ac5e
May 20 21:02:12.861991 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.861952    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99" event={"ID":"4bbf73fc-2992-42c6-8844-1a7871831ff7","Type":"ContainerStarted","Data":"0ef809aa11391c7ba5ad1b613115a61f60f16df046e8b107df0cfaa5afc2f863"}
May 20 21:02:12.862183 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:12.861998    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99" event={"ID":"4bbf73fc-2992-42c6-8844-1a7871831ff7","Type":"ContainerStarted","Data":"2118418fc3430c6aa72999bfe1707d5d77a921e127a247414dcedfbf4292ac5e"}
May 20 21:02:20.892692 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:20.892657    2554 generic.go:358] "Generic (PLEG): container finished" podID="4bbf73fc-2992-42c6-8844-1a7871831ff7" containerID="0ef809aa11391c7ba5ad1b613115a61f60f16df046e8b107df0cfaa5afc2f863" exitCode=0
May 20 21:02:20.893220 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:20.892731    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99" event={"ID":"4bbf73fc-2992-42c6-8844-1a7871831ff7","Type":"ContainerDied","Data":"0ef809aa11391c7ba5ad1b613115a61f60f16df046e8b107df0cfaa5afc2f863"}
May 20 21:02:21.898098 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:21.898046    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99" event={"ID":"4bbf73fc-2992-42c6-8844-1a7871831ff7","Type":"ContainerStarted","Data":"a3445654101dca9f4ab95a3cecf5ec26a405b67c8d654a8c29bae36ecbdf2ee7"}
May 20 21:02:21.898483 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:21.898261    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:21.919738 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:21.919686    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99" podStartSLOduration=9.707402006 podStartE2EDuration="9.919672054s" podCreationTimestamp="2026-05-20 21:02:12 +0000 UTC" firstStartedPulling="2026-05-20 21:02:20.893423551 +0000 UTC m=+825.286575351" lastFinishedPulling="2026-05-20 21:02:21.105693599 +0000 UTC m=+825.498845399" observedRunningTime="2026-05-20 21:02:21.918179591 +0000 UTC m=+826.311331414" watchObservedRunningTime="2026-05-20 21:02:21.919672054 +0000 UTC m=+826.312823876"
May 20 21:02:32.914401 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:32.914368    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-2wp99"
May 20 21:02:35.576260 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.576223    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7598c78c7c-5hbp5"]
May 20 21:02:35.605779 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.605744    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7598c78c7c-5hbp5"]
May 20 21:02:35.605929 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.605848    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.610086 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.610045    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5mcs2\""
May 20 21:02:35.610086 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.610059    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
May 20 21:02:35.610292 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.610059    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 20 21:02:35.641825 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.641791    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/53833efc-7bff-4da0-adbb-20323928ef2d-oidc-ca\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.641825 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.641829    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7lz\" (UniqueName: \"kubernetes.io/projected/53833efc-7bff-4da0-adbb-20323928ef2d-kube-api-access-cd7lz\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.642003 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.641920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53833efc-7bff-4da0-adbb-20323928ef2d-tls-cert\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.742682 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.742641    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53833efc-7bff-4da0-adbb-20323928ef2d-tls-cert\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.742844 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.742720    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/53833efc-7bff-4da0-adbb-20323928ef2d-oidc-ca\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.742844 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.742741    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7lz\" (UniqueName: \"kubernetes.io/projected/53833efc-7bff-4da0-adbb-20323928ef2d-kube-api-access-cd7lz\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.743417 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.743392    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/53833efc-7bff-4da0-adbb-20323928ef2d-oidc-ca\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.745097 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.745054    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53833efc-7bff-4da0-adbb-20323928ef2d-tls-cert\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.752472 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.752454    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd7lz\" (UniqueName: \"kubernetes.io/projected/53833efc-7bff-4da0-adbb-20323928ef2d-kube-api-access-cd7lz\") pod \"authorino-7598c78c7c-5hbp5\" (UID: \"53833efc-7bff-4da0-adbb-20323928ef2d\") " pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:35.915095 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:35.915001    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7598c78c7c-5hbp5"
May 20 21:02:36.044561 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:36.044457    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7598c78c7c-5hbp5"]
May 20 21:02:36.046695 ip-10-0-138-50 kubenswrapper[2554]: W0520 21:02:36.046664    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53833efc_7bff_4da0_adbb_20323928ef2d.slice/crio-ade866eadee3260fb2a871481a5fbfd3edc377ddbba46e74c2e93783ffa4cf58 WatchSource:0}: Error finding container ade866eadee3260fb2a871481a5fbfd3edc377ddbba46e74c2e93783ffa4cf58: Status 404 returned error can't find the container with id ade866eadee3260fb2a871481a5fbfd3edc377ddbba46e74c2e93783ffa4cf58
May 20 21:02:36.950542 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:36.950462    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7598c78c7c-5hbp5" event={"ID":"53833efc-7bff-4da0-adbb-20323928ef2d","Type":"ContainerStarted","Data":"8a9c6b65432796edf641fb9b652f157156d77d27edfe0a094dac66c017c4446b"}
May 20 21:02:36.950542 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:36.950504    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7598c78c7c-5hbp5" event={"ID":"53833efc-7bff-4da0-adbb-20323928ef2d","Type":"ContainerStarted","Data":"ade866eadee3260fb2a871481a5fbfd3edc377ddbba46e74c2e93783ffa4cf58"}
May 20 21:02:36.970703 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:02:36.970652    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7598c78c7c-5hbp5" podStartSLOduration=1.378180502 podStartE2EDuration="1.970637813s" podCreationTimestamp="2026-05-20 21:02:35 +0000 UTC" firstStartedPulling="2026-05-20 21:02:36.048186358 +0000 UTC m=+840.441338162" lastFinishedPulling="2026-05-20 21:02:36.64064367 +0000 UTC m=+841.033795473" observedRunningTime="2026-05-20 21:02:36.969608475 +0000 UTC m=+841.362760301" watchObservedRunningTime="2026-05-20 21:02:36.970637813 +0000 UTC m=+841.363789634"
May 20 21:03:02.475143 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:02.475103    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 21:03:02.475666 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:02.475361    2554 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" podUID="2445cd12-9a4f-43c0-b11d-91954b025ac1" containerName="keycloak-operator" containerID="cri-o://73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6" gracePeriod=30
May 20 21:03:02.929832 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:02.929806    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 21:03:03.041847 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.041757    2554 generic.go:358] "Generic (PLEG): container finished" podID="2445cd12-9a4f-43c0-b11d-91954b025ac1" containerID="73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6" exitCode=143
May 20 21:03:03.041847 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.041819    2554 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44"
May 20 21:03:03.042033 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.041847    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" event={"ID":"2445cd12-9a4f-43c0-b11d-91954b025ac1","Type":"ContainerDied","Data":"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"}
May 20 21:03:03.042033 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.041889    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c4df598dd-f5x44" event={"ID":"2445cd12-9a4f-43c0-b11d-91954b025ac1","Type":"ContainerDied","Data":"659834ba2b8b6412ccef83a736687488f18ace6294f9714119779686beb160ab"}
May 20 21:03:03.042033 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.041908    2554 scope.go:117] "RemoveContainer" containerID="73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"
May 20 21:03:03.050269 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.050250    2554 scope.go:117] "RemoveContainer" containerID="73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"
May 20 21:03:03.050572 ip-10-0-138-50 kubenswrapper[2554]: E0520 21:03:03.050552    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6\": container with ID starting with 73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6 not found: ID does not exist" containerID="73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"
May 20 21:03:03.050633 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.050582    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6"} err="failed to get container status \"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6\": rpc error: code = NotFound desc = could not find container \"73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6\": container with ID starting with 73d73511a4de57eb820e4855b42bb7531b089d0be54959c437b0e2b501a4fcd6 not found: ID does not exist"
May 20 21:03:03.097829 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.097788    2554 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwv6\" (UniqueName: \"kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6\") pod \"2445cd12-9a4f-43c0-b11d-91954b025ac1\" (UID: \"2445cd12-9a4f-43c0-b11d-91954b025ac1\") "
May 20 21:03:03.100050 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.100011    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6" (OuterVolumeSpecName: "kube-api-access-4wwv6") pod "2445cd12-9a4f-43c0-b11d-91954b025ac1" (UID: "2445cd12-9a4f-43c0-b11d-91954b025ac1"). InnerVolumeSpecName "kube-api-access-4wwv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:03:03.199405 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.199365    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwv6\" (UniqueName: \"kubernetes.io/projected/2445cd12-9a4f-43c0-b11d-91954b025ac1-kube-api-access-4wwv6\") on node \"ip-10-0-138-50.ec2.internal\" DevicePath \"\""
May 20 21:03:03.366110 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.366061    2554 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 21:03:03.372074 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:03.372032    2554 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/keycloak-operator-5c4df598dd-f5x44"]
May 20 21:03:04.146634 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:04.146596    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2445cd12-9a4f-43c0-b11d-91954b025ac1" path="/var/lib/kubelet/pods/2445cd12-9a4f-43c0-b11d-91954b025ac1/volumes"
May 20 21:03:14.243825 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.243740    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:14.244267 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.244155    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2445cd12-9a4f-43c0-b11d-91954b025ac1" containerName="keycloak-operator"
May 20 21:03:14.244267 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.244173    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2445cd12-9a4f-43c0-b11d-91954b025ac1" containerName="keycloak-operator"
May 20 21:03:14.244267 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.244254    2554 memory_manager.go:356] "RemoveStaleState removing state" podUID="2445cd12-9a4f-43c0-b11d-91954b025ac1" containerName="keycloak-operator"
May 20 21:03:14.246882 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.246864    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.249797 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.249775    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 20 21:03:14.249919 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.249892    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 21:03:14.251056 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.251038    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 21:03:14.251313 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.251288    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-kxnff\""
May 20 21:03:14.251421 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.251324    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
May 20 21:03:14.258922 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.258893    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:14.294397 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.294364    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-kube-api-access-bpd7w\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.294397 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.294411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-test-realms\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.395138 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.395086    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-kube-api-access-bpd7w\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.395138 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.395144    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-test-realms\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.395853 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.395832    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-test-realms\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.404827 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.404805    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58-kube-api-access-bpd7w\") pod \"maas-keycloak-0\" (UID: \"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.557331 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.557296    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.696599 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:14.696569    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:14.696747 ip-10-0-138-50 kubenswrapper[2554]: W0520 21:03:14.696647    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb9dd22_77fb_4ef4_a0f2_f4eea4e86d58.slice/crio-38a5848f575e43a93bed695ef3695d1881d66c83b11e3e5ff8d002649b0f9637 WatchSource:0}: Error finding container 38a5848f575e43a93bed695ef3695d1881d66c83b11e3e5ff8d002649b0f9637: Status 404 returned error can't find the container with id 38a5848f575e43a93bed695ef3695d1881d66c83b11e3e5ff8d002649b0f9637
May 20 21:03:15.085760 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:15.085718    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58","Type":"ContainerStarted","Data":"38a5848f575e43a93bed695ef3695d1881d66c83b11e3e5ff8d002649b0f9637"}
May 20 21:03:20.115864 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:20.115810    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58","Type":"ContainerStarted","Data":"05f63530f69828a6b1ae54a693fcb37c94b2b49ec6883f4d03371e3948ca929f"}
May 20 21:03:20.137434 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:20.137361    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.739361883 podStartE2EDuration="6.137341466s" podCreationTimestamp="2026-05-20 21:03:14 +0000 UTC" firstStartedPulling="2026-05-20 21:03:14.698205453 +0000 UTC m=+879.091357253" lastFinishedPulling="2026-05-20 21:03:19.096185033 +0000 UTC m=+883.489336836" observedRunningTime="2026-05-20 21:03:20.135538908 +0000 UTC m=+884.528690767" watchObservedRunningTime="2026-05-20 21:03:20.137341466 +0000 UTC m=+884.530493289"
May 20 21:03:20.558187 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:20.558133    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:20.560295 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:20.560254    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:21.558671 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:21.558620    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:22.558703 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:22.558636    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:23.557913 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:23.557867    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:24.558727 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:24.558272    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:24.560008 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:24.559322    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:25.558616 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:25.558556    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:26.559343 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:26.559291    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:27.558284 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:27.558232    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:28.558297 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:28.558251    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:29.558459 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:29.558398    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:30.558531 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:30.558471    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:31.557844 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:31.557798    2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.38:9000/health/started\": dial tcp 10.132.0.38:9000: connect: connection refused"
May 20 21:03:32.688723 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:32.688686    2554 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:32.709908 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:32.709860    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 21:03:36.091109 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:36.091056    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:03:36.091582 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:36.091534    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:03:36.095336 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:36.095314    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:03:36.095480 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:36.095338    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:03:42.693709 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:42.693664    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="abb9dd22-77fb-4ef4-a0f2-f4eea4e86d58" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 21:03:52.694768 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:03:52.694735    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 20 21:08:36.116645 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:08:36.116613    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:08:36.118786 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:08:36.118760    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:08:36.119649 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:08:36.119628    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:08:36.121812 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:08:36.121794    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:13:36.144664 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:13:36.144623    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:13:36.145721 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:13:36.145694    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:13:36.147754 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:13:36.147731    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:13:36.148994 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:13:36.148974    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:18:36.168313 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:18:36.168274    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:18:36.170739 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:18:36.170713    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:18:36.171378 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:18:36.171358    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:18:36.173643 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:18:36.173620    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:23:36.193881 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:23:36.193848    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:23:36.196607 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:23:36.195470    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:23:36.196985 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:23:36.196958    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:23:36.198637 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:23:36.198618    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l5wnr_77ef77fe-e174-42e1-9ff6-0b25936da704/ovn-acl-logging/0.log"
May 20 21:25:15.166714 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:15.166684    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7598c78c7c-5hbp5_53833efc-7bff-4da0-adbb-20323928ef2d/authorino/0.log"
May 20 21:25:20.563577 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:20.563544    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d5db49587-wp2hm_4e57ad3b-fe23-47b6-8373-4041b460ec4a/manager/0.log"
May 20 21:25:20.695418 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:20.695384    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mht44_8336f958-87d2-41b4-bc9f-855ecc13f170/postgres/0.log"
May 20 21:25:21.957427 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:21.957396    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7598c78c7c-5hbp5_53833efc-7bff-4da0-adbb-20323928ef2d/authorino/0.log"
May 20 21:25:22.298549 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:22.298467    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-hm6th_94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4/kuadrant-console-plugin/0.log"
May 20 21:25:23.448524 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:23.448474    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4c6b877d-b5cvr_543475a9-e40d-487c-96d4-c917368594ef/kube-auth-proxy/0.log"
May 20 21:25:24.489808 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:24.489777    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd_b3b6a565-6dce-4351-8432-10a219fbe68f/storage-initializer/0.log"
May 20 21:25:24.499042 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:24.499018    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc597hd_b3b6a565-6dce-4351-8432-10a219fbe68f/main/0.log"
May 20 21:25:24.726444 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:24.726405    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2wp99_4bbf73fc-2992-42c6-8844-1a7871831ff7/main/0.log"
May 20 21:25:24.735299 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:24.735276    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-2wp99_4bbf73fc-2992-42c6-8844-1a7871831ff7/storage-initializer/0.log"
May 20 21:25:31.908473 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:31.908440    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cqnn4_908bc7f1-3f83-473a-85c5-d05a6f45430e/global-pull-secret-syncer/0.log"
May 20 21:25:32.081536 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:32.081499    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzbqs_698bc62b-23ef-4dd6-aa60-13a1105addb5/konnectivity-agent/0.log"
May 20 21:25:32.171596 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:32.171494    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-50.ec2.internal_da7a165be79b358443c245d49aec95fe/haproxy/0.log"
May 20 21:25:36.710225 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:36.710195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7598c78c7c-5hbp5_53833efc-7bff-4da0-adbb-20323928ef2d/authorino/0.log"
May 20 21:25:36.790323 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:36.790293    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-hm6th_94c61d9c-6f1d-4b84-a747-8ec0e6b97ec4/kuadrant-console-plugin/0.log"
May 20 21:25:38.708514 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.708461    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-ppcnl_3bad82d2-518b-4383-bec6-5e83738b143b/cluster-monitoring-operator/0.log"
May 20 21:25:38.808651 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.808621    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-757fc576b7-xdqcd_9bf9c082-0d58-497f-af36-a261a967901a/metrics-server/0.log"
May 20 21:25:38.834122 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.834093    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-6t6pj_fdf0e2be-9028-4481-b11e-8c9e4bdeb732/monitoring-plugin/0.log"
May 20 21:25:38.863832 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.863806    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brszx_2699d670-75b8-400f-ac8a-d568ce5e0ac7/node-exporter/0.log"
May 20 21:25:38.888772 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.888746    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brszx_2699d670-75b8-400f-ac8a-d568ce5e0ac7/kube-rbac-proxy/0.log"
May 20 21:25:38.916135 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:38.916112    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brszx_2699d670-75b8-400f-ac8a-d568ce5e0ac7/init-textfile/0.log"
May 20 21:25:39.253852 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.253825    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/prometheus/0.log"
May 20 21:25:39.279965 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.279928    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/config-reloader/0.log"
May 20 21:25:39.302144 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.302119    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/thanos-sidecar/0.log"
May 20 21:25:39.327049 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.327025    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/kube-rbac-proxy-web/0.log"
May 20 21:25:39.354600 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.354564    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/kube-rbac-proxy/0.log"
May 20 21:25:39.377422 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.377398    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/kube-rbac-proxy-thanos/0.log"
May 20 21:25:39.401022 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.400994    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa63d453-8c3a-4970-a710-ff3515d112b0/init-config-reloader/0.log"
May 20 21:25:39.438735 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.438701    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cf2dp_0bfec882-b54a-491d-ab83-138b1003a438/prometheus-operator/0.log"
May 20 21:25:39.458681 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.458633    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-cf2dp_0bfec882-b54a-491d-ab83-138b1003a438/kube-rbac-proxy/0.log"
May 20 21:25:39.513837 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.513745    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677fd4b6c9-kc5hr_4ec569b8-3456-4ecd-962c-88cebe1fda99/telemeter-client/0.log"
May 20 21:25:39.537185 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.537139    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677fd4b6c9-kc5hr_4ec569b8-3456-4ecd-962c-88cebe1fda99/reload/0.log"
May 20 21:25:39.559841 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:39.559818    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677fd4b6c9-kc5hr_4ec569b8-3456-4ecd-962c-88cebe1fda99/kube-rbac-proxy/0.log"
May 20 21:25:40.181252 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.181215    2554 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"]
May 20 21:25:40.184604 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.184586    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.187214 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.187188    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s85mv\"/\"kube-root-ca.crt\""
May 20 21:25:40.188171 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.188147    2554 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s85mv\"/\"default-dockercfg-srg7g\""
May 20 21:25:40.188171 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.188144    2554 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s85mv\"/\"openshift-service-ca.crt\""
May 20 21:25:40.190802 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.190775    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"]
May 20 21:25:40.288792 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.288751    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-sys\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.288792 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.288795    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-lib-modules\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.289001 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.288870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9dq\" (UniqueName: \"kubernetes.io/projected/0ce1770a-1442-4566-9b01-f1817a8f2948-kube-api-access-vh9dq\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.289001 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.288915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-proc\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.289001 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.288943    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-podres\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.389857 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389821    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-sys\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.389857 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389864    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-lib-modules\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389905    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9dq\" (UniqueName: \"kubernetes.io/projected/0ce1770a-1442-4566-9b01-f1817a8f2948-kube-api-access-vh9dq\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389936    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-proc\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389946    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-sys\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.389985    2554 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-podres\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.390009    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-proc\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390090 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.390076    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-podres\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.390305 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.390093    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ce1770a-1442-4566-9b01-f1817a8f2948-lib-modules\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.398881 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.398856    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9dq\" (UniqueName: \"kubernetes.io/projected/0ce1770a-1442-4566-9b01-f1817a8f2948-kube-api-access-vh9dq\") pod \"perf-node-gather-daemonset-mdw7t\" (UID: \"0ce1770a-1442-4566-9b01-f1817a8f2948\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.495440 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.495348    2554 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.624760 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.624705    2554 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"]
May 20 21:25:40.627533 ip-10-0-138-50 kubenswrapper[2554]: W0520 21:25:40.627503    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ce1770a_1442_4566_9b01_f1817a8f2948.slice/crio-827852baedb4aad2df0c4dacb078f1f4fbb676cdf98c83b34fff247b008b349f WatchSource:0}: Error finding container 827852baedb4aad2df0c4dacb078f1f4fbb676cdf98c83b34fff247b008b349f: Status 404 returned error can't find the container with id 827852baedb4aad2df0c4dacb078f1f4fbb676cdf98c83b34fff247b008b349f
May 20 21:25:40.629136 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.629121    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:25:40.818640 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.818600    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t" event={"ID":"0ce1770a-1442-4566-9b01-f1817a8f2948","Type":"ContainerStarted","Data":"f089b46997ed0bf0cbcd6f1f4f716e0c750faa98f00e371df6282b9a82751b01"}
May 20 21:25:40.818640 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.818642    2554 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t" event={"ID":"0ce1770a-1442-4566-9b01-f1817a8f2948","Type":"ContainerStarted","Data":"827852baedb4aad2df0c4dacb078f1f4fbb676cdf98c83b34fff247b008b349f"}
May 20 21:25:40.818892 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.818675    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:40.836314 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:40.836261    2554 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t" podStartSLOduration=0.836246625 podStartE2EDuration="836.246625ms" podCreationTimestamp="2026-05-20 21:25:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:25:40.834467092 +0000 UTC m=+2225.227618915" watchObservedRunningTime="2026-05-20 21:25:40.836246625 +0000 UTC m=+2225.229398446"
May 20 21:25:41.331357 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:41.331329    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/1.log"
May 20 21:25:41.340226 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:41.340194    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-tvq8c_1626ba63-0db1-4f37-a387-616f6d72b61d/console-operator/2.log"
May 20 21:25:41.955684 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:41.955643    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-jjgfq_5afb596b-3dbf-4692-a146-4d30c2987e74/download-server/0.log"
May 20 21:25:42.443796 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:42.443762    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-z4lwg_1f04c240-9f3b-4099-a6ab-cf38685b6a75/volume-data-source-validator/0.log"
May 20 21:25:43.361621 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:43.361592    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4mhkn_1c09013d-3827-4be6-885a-8edf54feb99a/dns/0.log"
May 20 21:25:43.386045 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:43.386015    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4mhkn_1c09013d-3827-4be6-885a-8edf54feb99a/kube-rbac-proxy/0.log"
May 20 21:25:43.514315 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:43.514283    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpnzz_ec7ceacc-9434-4760-91b2-bfd8d1968433/dns-node-resolver/0.log"
May 20 21:25:44.001929 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:44.001895    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c5fd8d896-zkfrr_1036e916-de14-492c-9f00-2af0e63c0446/registry/0.log"
May 20 21:25:44.053833 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:44.053791    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rg7sz_b35756ef-24c6-4565-ae5b-36b161302041/node-ca/0.log"
May 20 21:25:45.173919 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:45.173887    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4c6b877d-b5cvr_543475a9-e40d-487c-96d4-c917368594ef/kube-auth-proxy/0.log"
May 20 21:25:45.941762 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:45.941727    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j97vz_bd5309f4-2558-42c7-9107-acd0d3b08205/serve-healthcheck-canary/0.log"
May 20 21:25:46.522789 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:46.522761    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmh86_776416a8-cce7-4e89-8e1f-90f23694b48f/kube-rbac-proxy/0.log"
May 20 21:25:46.547720 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:46.547690    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmh86_776416a8-cce7-4e89-8e1f-90f23694b48f/exporter/0.log"
May 20 21:25:46.578056 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:46.578024    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmh86_776416a8-cce7-4e89-8e1f-90f23694b48f/extractor/0.log"
May 20 21:25:46.832214 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:46.832187    2554 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-mdw7t"
May 20 21:25:49.045594 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:49.045563    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d5db49587-wp2hm_4e57ad3b-fe23-47b6-8373-4041b460ec4a/manager/0.log"
May 20 21:25:49.073037 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:49.073007    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mht44_8336f958-87d2-41b4-bc9f-855ecc13f170/postgres/0.log"
May 20 21:25:50.577830 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:50.577801    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d8d69f6f7-ff8wc_8e0212df-bdf2-4298-b9c0-c49cc3f43e93/manager/0.log"
May 20 21:25:55.430992 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:55.430906    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j6grc_8a6ba428-9f03-412d-8813-b31775e6a0c3/kube-storage-version-migrator-operator/1.log"
May 20 21:25:55.432595 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:55.432567    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-j6grc_8a6ba428-9f03-412d-8813-b31775e6a0c3/kube-storage-version-migrator-operator/0.log"
May 20 21:25:56.414111 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.414052    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/kube-multus-additional-cni-plugins/0.log"
May 20 21:25:56.438492 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.438465    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/egress-router-binary-copy/0.log"
May 20 21:25:56.461249 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.461215    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/cni-plugins/0.log"
May 20 21:25:56.484799 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.484765    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/bond-cni-plugin/0.log"
May 20 21:25:56.506838 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.506807    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/routeoverride-cni/0.log"
May 20 21:25:56.532332 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.532298    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/whereabouts-cni-bincopy/0.log"
May 20 21:25:56.554913 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:56.554878    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-56w4f_6f9e25ca-edda-48fd-a372-0cf38291580c/whereabouts-cni/0.log"
May 20 21:25:57.034380 ip-10-0-138-50 kubenswrapper[2554]: I0520 21:25:57.034333    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gr9ww_02255042-815b-4e26-ba43-fef8bdc21549/kube-multus/0.log"