May 28 07:56:31.953127 ip-10-0-141-246 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 07:56:31.953140 ip-10-0-141-246 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 07:56:31.953149 ip-10-0-141-246 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 07:56:31.953450 ip-10-0-141-246 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 07:56:43.120056 ip-10-0-141-246 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 07:56:43.120073 ip-10-0-141-246 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 08cfe327387a4047b63ec4b197c65abb --
May 28 07:59:00.127926 ip-10-0-141-246 systemd[1]: Starting Kubernetes Kubelet...
May 28 07:59:00.576384 ip-10-0-141-246 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:59:00.576384 ip-10-0-141-246 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 07:59:00.576384 ip-10-0-141-246 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:59:00.576384 ip-10-0-141-246 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 07:59:00.576384 ip-10-0-141-246 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 07:59:00.580590 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.580506    2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 07:59:00.585528 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585512    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585529    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585534    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585538    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585541    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585545    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585548    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585551    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585554    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585557    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585559    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585562    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585565    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585568    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:59:00.585566 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585572    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585577    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585580    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585583    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585586    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585589    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585591    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585594    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585597    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585599    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585602    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585605    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585608    2560 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585610    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585613    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585616    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585618    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585621    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585624    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585626    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:59:00.585937 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585629    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585631    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585633    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585636    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585638    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585641    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585644    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585647    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585650    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585667    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585672    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585676    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585680    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585682    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585685    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585690    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585694    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585697    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585699    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585702    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:59:00.586416 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585705    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585708    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585711    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585713    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585716    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585719    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585721    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585724    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585727    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585729    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585732    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585735    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585737    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585740    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585744    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585746    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585749    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585752    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585755    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585758    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:59:00.586953 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585760    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585763    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585766    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585769    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585771    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585774    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585776    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585779    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585782    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585785    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585787    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.585790    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586190    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586195    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586198    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586202    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586205    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586208    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586211    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586213    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:59:00.587431 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586216    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586218    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586221    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586224    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586228    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586232    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586234    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586237    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586241    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586244    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586248    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586251    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586253    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586256    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586259    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586261    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586264    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586266    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586269    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:59:00.587929 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586272    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586276    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586280    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586283    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586286    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586289    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586293    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586295    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586298    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586301    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586304    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586306    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586309    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586311    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586314    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586316    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586319    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586321    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586324    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586327    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:59:00.588390 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586330    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586332    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586336    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586339    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586341    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586344    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586347    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586349    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586352    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586354    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586357    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586361    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586363    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586366    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586369    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586371    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586374    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586376    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586379    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:59:00.588900 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586381    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586384    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586386    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586389    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586391    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586394    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586397    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586400    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586403    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586406    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586408    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586411    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586413    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586416    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586419    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586422    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586425    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586428    2560 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586430    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.586433    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:59:00.589376 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588236    2560 flags.go:64] FLAG: --address="0.0.0.0"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588246    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588253    2560 flags.go:64] FLAG: --anonymous-auth="true"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588258    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588263    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588266    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588271    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588275    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588279    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588282    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588285    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588288    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588292    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588295    2560 flags.go:64] FLAG: --cgroup-root=""
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588298    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588301    2560 flags.go:64] FLAG: --client-ca-file=""
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588303    2560 flags.go:64] FLAG: --cloud-config=""
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588306    2560 flags.go:64] FLAG: --cloud-provider="external"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588309    2560 flags.go:64] FLAG: --cluster-dns="[]"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588314    2560 flags.go:64] FLAG: --cluster-domain=""
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588317    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588320    2560 flags.go:64] FLAG: --config-dir=""
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588323    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588327    2560 flags.go:64] FLAG: --container-log-max-files="5"
May 28 07:59:00.589875 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588331    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588335    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588338    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588341    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588344    2560 flags.go:64] FLAG: --contention-profiling="false"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588349    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588352    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588356    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588358    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588363    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588366    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588369    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588372    2560 flags.go:64] FLAG: --enable-load-reader="false"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588375    2560 flags.go:64] FLAG: --enable-server="true"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588378    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588383    2560 flags.go:64] FLAG: --event-burst="100"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588386    2560 flags.go:64] FLAG: --event-qps="50"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588389    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588392    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588395    2560 flags.go:64] FLAG: --eviction-hard=""
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588399    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588402    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588405    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588409    2560 flags.go:64] FLAG: --eviction-soft=""
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588412    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 07:59:00.590486 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588414    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588417    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588420    2560 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588423    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588426    2560 flags.go:64] FLAG: --fail-swap-on="true"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588429    2560 flags.go:64] FLAG: --feature-gates=""
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588433    2560 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588436    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588440    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588443    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588446    2560 flags.go:64] FLAG: --healthz-port="10248"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588449    2560 flags.go:64] FLAG: --help="false"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588453    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-141-246.ec2.internal"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588456    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588460    2560 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588463    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588467    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588470    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588473    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588476    2560 flags.go:64] FLAG: --image-service-endpoint=""
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588479    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588482    2560 flags.go:64] FLAG: --kube-api-burst="100"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588485    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588488    2560 flags.go:64] FLAG: --kube-api-qps="50"
May 28 07:59:00.591108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588491    2560 flags.go:64] FLAG: --kube-reserved=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588494    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588497    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588500    2560 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588503    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588506    2560 flags.go:64] FLAG: --lock-file=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588509    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588512    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588515    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588520    2560 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588523    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588526    2560 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588528    2560 flags.go:64] FLAG: --logging-format="text"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588531    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588538    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588541    2560 flags.go:64] FLAG: --manifest-url=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588544    2560 flags.go:64] FLAG: --manifest-url-header=""
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588549    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588552    2560 flags.go:64] FLAG: --max-open-files="1000000"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588556    2560 flags.go:64] FLAG: --max-pods="110"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588559    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588562    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588566    2560 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588570    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588573    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 07:59:00.591700 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588575    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588578    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588586    2560 flags.go:64] FLAG: --node-status-max-images="50"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588589    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588592    2560 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588595    2560 flags.go:64] FLAG: --pod-cidr=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588598    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588604    2560 flags.go:64] FLAG: --pod-manifest-path=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588608    2560 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588611    2560 flags.go:64] FLAG: --pods-per-core="0"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588614    2560 flags.go:64] FLAG: --port="10250"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588617    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588619    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b7c0dee69ce869b"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588623    2560 flags.go:64] FLAG: --qos-reserved=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588626    2560 flags.go:64] FLAG: --read-only-port="10255"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588629    2560 flags.go:64] FLAG: --register-node="true"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588632    2560 flags.go:64] FLAG: --register-schedulable="true"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588635    2560 flags.go:64] FLAG: --register-with-taints=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588638    2560 flags.go:64] FLAG: --registry-burst="10"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588641    2560 flags.go:64] FLAG: --registry-qps="5"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588644    2560 flags.go:64] FLAG: --reserved-cpus=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588647    2560 flags.go:64] FLAG: --reserved-memory=""
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588663    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588666    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588669    2560 flags.go:64] FLAG: --rotate-certificates="false"
May 28 07:59:00.592339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588673    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588676    2560 flags.go:64] FLAG: --runonce="false"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588679    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588682    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588685    2560 flags.go:64] FLAG: --seccomp-default="false"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588689    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588692    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588695    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588698    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588702    2560 flags.go:64] FLAG: --storage-driver-password="root"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588705    2560 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588708    2560 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588711    2560 flags.go:64] FLAG: --storage-driver-user="root"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588713    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588716    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588719    2560 flags.go:64] FLAG: --system-cgroups=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588722    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588727    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588747    2560 flags.go:64] FLAG: --tls-cert-file=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588750    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588756    2560 flags.go:64] FLAG: --tls-min-version=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588759    2560 flags.go:64] FLAG: --tls-private-key-file=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588762    2560 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588765    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588768    2560 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 07:59:00.592953 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588771    2560 flags.go:64] FLAG: --v="2"
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588776    2560 flags.go:64] FLAG: --version="false"
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588780    2560 flags.go:64] FLAG: --vmodule=""
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588784    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.588789    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588892    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588896    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588900    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588905    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588908    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588910    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588913    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588916    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588920    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588924    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588928    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588931    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588960    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588973    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588977    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:59:00.593563 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588981    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588984    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588989    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588992    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588995    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.588998    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589001    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589003    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589009    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589013    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589016    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589019    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589022    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589025    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589028    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589031    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589034    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589036    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589040    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:59:00.594100 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589043    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589045    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589048    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589051    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589054    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589057    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589060    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589063    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589065    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589068    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589071    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589075    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589078    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589082    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589084    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589087    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589090    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589093    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589095    2560 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589098    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:59:00.594589 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589100    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589103    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589105    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589108    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589111    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589113    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589116    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589119    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589121    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589132    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589135    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589137    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589140    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589142    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589145    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589148    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589151    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589154    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589156    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589159    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:59:00.595095 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589162    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589165    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589167    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589171    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589175    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589177    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589180    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589183    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589186    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589188    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589191    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.589194    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:59:00.595595 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.589841    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:59:00.596354 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.596335    2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 07:59:00.596387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.596355    2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 07:59:00.596414 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596404    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:59:00.596414 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596410    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:59:00.596414 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596413    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596416    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596419    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596422    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596426    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596429    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596431    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596434    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596437    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596439    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596442    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596445    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596447    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596450    2560 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596453    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596456    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596459    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596461    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596464    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596473    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:59:00.596491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596476    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596479    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596481    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596484    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596486    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596489    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596492    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596496    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596501    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596504    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596508    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596510    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596513    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596516    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596519    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596522    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596524    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596527    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596530    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:59:00.596993 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596533    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596537    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596541    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596544    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596546    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596549    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596551    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596554    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596557    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596559    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596563    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596566    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596568    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596577    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596580    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596583    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596586    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596588    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596591    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596594    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:59:00.597464 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596597    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596599    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596602    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596605    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596607    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596610    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596612    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596615    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596618    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596620    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596623    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596625    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596628    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596631    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596633    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596636    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596638    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596641    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596643    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596646    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:59:00.598010 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596648    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596651    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596669    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596672    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596675    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.596680    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596795    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596800    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596803    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596806    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596809    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596812    2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596815    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596818    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596821    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 07:59:00.598491 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596823    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596826    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596829    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596832    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596834    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596837    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596839    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596842    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596844    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596847    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596850    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596854    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596857    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596860    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596862    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596865    2560 feature_gate.go:328] unrecognized feature gate: Example
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596868    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596870    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596873    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596876    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 07:59:00.598876 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596878    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596881    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596884    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596886    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596897    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596900    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596902    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596905    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596907    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596910    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596912    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596915    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596917    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596920    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596923    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596925    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596928    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596930    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596933    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 07:59:00.599364 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596935    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596938    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596940    2560 feature_gate.go:328] unrecognized feature gate: Example2
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596943    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596945    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596947    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596950    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596953    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596955    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596958    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596960    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596963    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596965    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596968    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596970    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596973    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596975    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596978    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596987    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596989    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 07:59:00.599834 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596992    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596994    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.596997    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597000    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597002    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597005    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597012    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597015    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597019    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597023    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597025    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597028    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597031    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597034    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597037    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597039    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597042    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 07:59:00.600317 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:00.597045    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 07:59:00.600741 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.597050    2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 07:59:00.600741 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.597833    2560 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 07:59:00.600741 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.600112    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 07:59:00.601008 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.600996    2560 server.go:1019] "Starting client certificate rotation"
May 28 07:59:00.601110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.601095    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 07:59:00.601811 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.601800    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 07:59:00.628713 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.628692    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 07:59:00.636627 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.636598    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 07:59:00.653376 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.653355    2560 log.go:25] "Validated CRI v1 runtime API"
May 28 07:59:00.658859 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.658839    2560 log.go:25] "Validated CRI v1 image API"
May 28 07:59:00.660204 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.660184    2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 07:59:00.663188 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.663172    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 07:59:00.667339 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.667313    2560 fs.go:135] Filesystem UUIDs: map[6f0534c5-680c-4f83-aea8-2c615168dec2:/dev/nvme0n1p3 6ff58d87-62a0-49d2-aa1f-ac84902d3fda:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 28 07:59:00.667410 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.667338    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 07:59:00.671860 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.671754    2560 manager.go:217] Machine: {Timestamp:2026-05-28 07:59:00.671225252 +0000 UTC m=+0.422697884 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097465 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec280cbed999bc26dd73e299f581d44a SystemUUID:ec280cbe-d999-bc26-dd73-e299f581d44a BootID:08cfe327-387a-4047-b63e-c4b197c65abb Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:19:0c:71:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:19:0c:71:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:04:12:9e:99:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 07:59:00.672823 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.672812    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 07:59:00.672940 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.672928    2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 07:59:00.674942 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.674916    2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 07:59:00.675126 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.674945    2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 07:59:00.675208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.675141    2560 topology_manager.go:138] "Creating topology manager with none policy"
May 28 07:59:00.675208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.675153    2560 container_manager_linux.go:306] "Creating device plugin manager"
May 28 07:59:00.675208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.675163    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 07:59:00.675208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.675181    2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 07:59:00.676979 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.676965    2560 state_mem.go:36] "Initialized new in-memory state store"
May 28 07:59:00.677115 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.677104    2560 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 07:59:00.679580 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.679569    2560 kubelet.go:491] "Attempting to sync node with API server"
May 28 07:59:00.679637 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.679591    2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 07:59:00.679637 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.679607    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 07:59:00.679637 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.679622    2560 kubelet.go:397] "Adding apiserver pod source"
May 28 07:59:00.679637 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.679635    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 07:59:00.681032 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.681018    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 07:59:00.681096 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.681042    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 07:59:00.685456 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.685439    2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 07:59:00.687607 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.687592    2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 07:59:00.689175 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689154    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689184    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689197    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689219    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689234    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689243    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 07:59:00.689250 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689253    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 07:59:00.689406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689262    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 07:59:00.689406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689273    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 07:59:00.689406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689283    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 07:59:00.689406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689329    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 07:59:00.689530 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.689503    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 07:59:00.690985 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.690967    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 07:59:00.691052 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.691001    2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 07:59:00.694422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.694407    2560 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 07:59:00.694504 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.694451    2560 server.go:1295] "Started kubelet"
May 28 07:59:00.695406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.695372    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 07:59:00.695406 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.695340    2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 07:59:00.695503 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.695436    2560 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 07:59:00.695589 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.695569    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 07:59:00.695692 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.695678    2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 07:59:00.695745 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.695731    2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 07:59:00.696265 ip-10-0-141-246 systemd[1]: Started Kubernetes Kubelet.
May 28 07:59:00.697710 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.697576    2560 server.go:317] "Adding debug handlers to kubelet server"
May 28 07:59:00.699860 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.699841    2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 07:59:00.699952 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.699874    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fr664"
May 28 07:59:00.702683 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.701224    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-246.ec2.internal.18b3abc51538a902  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-246.ec2.internal,UID:ip-10-0-141-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-246.ec2.internal,},FirstTimestamp:2026-05-28 07:59:00.694419714 +0000 UTC m=+0.445892346,LastTimestamp:2026-05-28 07:59:00.694419714 +0000 UTC m=+0.445892346,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-246.ec2.internal,}"
May 28 07:59:00.705435 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.705416    2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 07:59:00.705850 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.705838    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 07:59:00.705935 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.705913    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 07:59:00.706020 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.705972    2560 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 07:59:00.706020 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.705984    2560 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 07:59:00.706222 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706203    2560 reconstruct.go:97] "Volume reconstruction finished"
May 28 07:59:00.706222 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706221    2560 reconciler.go:26] "Reconciler: start to sync state"
May 28 07:59:00.706318 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706236    2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 07:59:00.706637 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.706619    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:00.706758 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706688    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fr664"
May 28 07:59:00.706856 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706761    2560 factory.go:55] Registering systemd factory
May 28 07:59:00.706856 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.706781    2560 factory.go:223] Registration of the systemd container factory successfully
May 28 07:59:00.707136 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707111    2560 factory.go:153] Registering CRI-O factory
May 28 07:59:00.707136 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707125    2560 factory.go:223] Registration of the crio container factory successfully
May 28 07:59:00.707265 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707249    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 07:59:00.707318 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707275    2560 factory.go:103] Registering Raw factory
May 28 07:59:00.707318 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707292    2560 manager.go:1196] Started watching for new ooms in manager
May 28 07:59:00.707693 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.707681    2560 manager.go:319] Starting recovery of all containers
May 28 07:59:00.711296 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.711277    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:00.713418 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.713396    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-246.ec2.internal\" not found" node="ip-10-0-141-246.ec2.internal"
May 28 07:59:00.719136 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.719120    2560 manager.go:324] Recovery completed
May 28 07:59:00.721380 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.721326    2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 07:59:00.724639 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.724625    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.726740 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.726725    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.726803 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.726753    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.726803 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.726763    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.727287 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.727272    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 07:59:00.727287 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.727286    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 07:59:00.727366 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.727303    2560 state_mem.go:36] "Initialized new in-memory state store"
May 28 07:59:00.729733 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.729716    2560 policy_none.go:49] "None policy: Start"
May 28 07:59:00.729733 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.729733    2560 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 07:59:00.729874 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.729743    2560 state_mem.go:35] "Initializing new in-memory state store"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.776810    2560 manager.go:341] "Starting Device Plugin manager"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.776853    2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.776867    2560 server.go:85] "Starting device plugin registration server"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.777114    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.777132    2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.777232    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.777326    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.777337    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.777835    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 07:59:00.788422 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.777872    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:00.804783 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.804758    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 07:59:00.805999 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.805984    2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 07:59:00.806088 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.806005    2560 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 07:59:00.806088 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.806021    2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 07:59:00.806088 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.806028    2560 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 07:59:00.806088 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.806064    2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 07:59:00.808433 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.808410    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:00.877522 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.877443    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.878492 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.878476    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.878599 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.878511    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.878599 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.878526    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.878599 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.878555    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-246.ec2.internal"
May 28 07:59:00.891092 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.891073    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-246.ec2.internal"
May 28 07:59:00.891157 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.891097    2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-246.ec2.internal\": node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:00.905599 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.905575    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:00.906532 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.906514    2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"]
May 28 07:59:00.906605 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.906592    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.907364 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.907349    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.907439 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.907379    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.907439 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.907392    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.908583 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.908569    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.908743 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.908730    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:00.908800 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.908759    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.909278 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909259    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.909341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909282    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.909341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909291    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.909341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909301    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.909341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909306    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.909341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.909311    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.910461 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.910447    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:00.910521 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.910470    2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 07:59:00.911094 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.911081    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientMemory"
May 28 07:59:00.911166 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.911103    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasNoDiskPressure"
May 28 07:59:00.911166 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:00.911126    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeHasSufficientPID"
May 28 07:59:00.939319 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.939294    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-246.ec2.internal\" not found" node="ip-10-0-141-246.ec2.internal"
May 28 07:59:00.943578 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:00.943562    2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-246.ec2.internal\" not found" node="ip-10-0-141-246.ec2.internal"
May 28 07:59:01.006574 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.006540    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.106835 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.106800    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.106974 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.106854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fa0fdf0c2348838da79ae1cda82e96b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-246.ec2.internal\" (UID: \"0fa0fdf0c2348838da79ae1cda82e96b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.106974 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.106880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.106974 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.106903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207469 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.207389    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.207469 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207464    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207622 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207493    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207622 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207508    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fa0fdf0c2348838da79ae1cda82e96b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-246.ec2.internal\" (UID: \"0fa0fdf0c2348838da79ae1cda82e96b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207622 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207547    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fa0fdf0c2348838da79ae1cda82e96b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-246.ec2.internal\" (UID: \"0fa0fdf0c2348838da79ae1cda82e96b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207622 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207574    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.207622 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.207579    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8943d242546d7e92f8c842fda362a274-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal\" (UID: \"8943d242546d7e92f8c842fda362a274\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.242580 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.242559    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.246326 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.246311    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:01.308218 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.308183    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.408585 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.408556    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.509032 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.508951    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.601296 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.601261    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 07:59:01.601982 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.601432    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 07:59:01.601982 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.601451    2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 07:59:01.609591 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.609563    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.706192 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.706164    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 07:59:01.708322 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.708295    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 07:54:00 +0000 UTC" deadline="2028-01-16 20:27:44.420848765 +0000 UTC"
May 28 07:59:01.708322 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.708320    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14364h28m42.712530815s"
May 28 07:59:01.710545 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.710525    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.716388 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.716364    2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 07:59:01.756305 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.756276    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xl9d9"
May 28 07:59:01.761821 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.761802    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xl9d9"
May 28 07:59:01.798784 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.798761    2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:01.810880 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.810851    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:01.894310 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:01.894267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa0fdf0c2348838da79ae1cda82e96b.slice/crio-2c366444a9d1f8f769d13d8829dfb37c9b55806e11e0dfd73231c70d1ccc6084 WatchSource:0}: Error finding container 2c366444a9d1f8f769d13d8829dfb37c9b55806e11e0dfd73231c70d1ccc6084: Status 404 returned error can't find the container with id 2c366444a9d1f8f769d13d8829dfb37c9b55806e11e0dfd73231c70d1ccc6084
May 28 07:59:01.894511 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:01.894492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8943d242546d7e92f8c842fda362a274.slice/crio-0bef0ca02211a6a3ec5f6949a3d7d03d3591433ffa36bae51982715e22763643 WatchSource:0}: Error finding container 0bef0ca02211a6a3ec5f6949a3d7d03d3591433ffa36bae51982715e22763643: Status 404 returned error can't find the container with id 0bef0ca02211a6a3ec5f6949a3d7d03d3591433ffa36bae51982715e22763643
May 28 07:59:01.898632 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:01.898618    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 07:59:01.911467 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:01.911449    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:02.011928 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.011843    2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-246.ec2.internal\" not found"
May 28 07:59:02.065568 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.065543    2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:02.106616 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.106574    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal"
May 28 07:59:02.119702 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.119681    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 07:59:02.121081 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.121070    2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal"
May 28 07:59:02.131993 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.131977    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 07:59:02.680819 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.680782    2560 apiserver.go:52] "Watching apiserver"
May 28 07:59:02.687774 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.687752    2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:02.688935 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.688913    2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 07:59:02.689337 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.689310    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-r4854","openshift-dns/node-resolver-x6h8q","openshift-image-registry/node-ca-v2zms","openshift-multus/multus-additional-cni-plugins-jxsjb","openshift-multus/multus-sh5nm","openshift-network-diagnostics/network-check-target-92x5x","openshift-network-operator/iptables-alerter-hm562","kube-system/konnectivity-agent-ts8lq","kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal","openshift-multus/network-metrics-daemon-rw9j6","openshift-ovn-kubernetes/ovnkube-node-h96rd"]
May 28 07:59:02.692305 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.692036    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.695995 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.695257    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 07:59:02.695995 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.695375    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 07:59:02.695995 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.695424    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5nj7\""
May 28 07:59:02.696729 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.696367    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.698518 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.698498    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.698636 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.698617    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.699136 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699113    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 07:59:02.699217 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699162    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 07:59:02.699217 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699172    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 07:59:02.699343 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699301    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 07:59:02.699826 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699807    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hpls4\""
May 28 07:59:02.700004 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.699989    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 07:59:02.700184 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.700166    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 07:59:02.700799 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.700765    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.700962 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.700944    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 07:59:02.701506 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.701487    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 07:59:02.702073 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702052    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 07:59:02.702786 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702202    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 07:59:02.702786 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702139    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2jjw6\""
May 28 07:59:02.702786 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702377    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 07:59:02.702786 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702615    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pclqd\""
May 28 07:59:02.702786 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.702770    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 07:59:02.703055 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703002    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:02.703107 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.703089    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:02.703166 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703119    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 07:59:02.703452 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703436    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 07:59:02.703988 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703628    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 07:59:02.703988 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703712    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 07:59:02.703988 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703721    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 07:59:02.703988 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.703762    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qts89\""
May 28 07:59:02.705251 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.705233    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.707510 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.707492    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 07:59:02.707833 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.707809    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.708132 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.707884    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9977k\""
May 28 07:59:02.708330 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.708312    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 07:59:02.708562 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.708545    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 07:59:02.710042 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.710024    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.711716 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.711540    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 07:59:02.713173 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.711894    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-85gtk\""
May 28 07:59:02.713563 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.713539    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.713673 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.713622    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:02.714046 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.713786    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 07:59:02.714046 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.713949    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mwvmm\""
May 28 07:59:02.714046 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.713962    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 07:59:02.715935 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.715874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-socket-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.716079 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-k8s-cni-cncf-io\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.716255 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hxwb\" (UniqueName: \"kubernetes.io/projected/353ec337-7a4b-4f38-9bf6-b39f3aca7021-kube-api-access-6hxwb\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.716374 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-systemd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.716505 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.716603 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.716733 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716130    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.716853 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.716965 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.716941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-multus\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.717056 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-conf-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.717056 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-etc-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717158 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-node-log\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717307 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717368 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-log-socket\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717368 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-config\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717464 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010cd40a-b776-49aa-ae85-e932a37233b1-ovn-node-metrics-cert\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717464 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-script-lib\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717464 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-systemd-units\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717464 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-ovn\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-kubelet\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15f13d54-560a-4da9-bb9f-4e60707e902b-iptables-alerter-script\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-device-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-bin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-cnibin\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-netd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgjrl\" (UniqueName: \"kubernetes.io/projected/51ecdec3-1e94-4b4e-9889-fe093d29749f-kube-api-access-sgjrl\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.717670 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-hostroot\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-slash\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5371b78-e249-4770-9029-8d8b46048db6-agent-certs\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-netns\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6vh\" (UniqueName: \"kubernetes.io/projected/010cd40a-b776-49aa-ae85-e932a37233b1-kube-api-access-zp6vh\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfcm8\" (UniqueName: \"kubernetes.io/projected/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-kube-api-access-zfcm8\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-netns\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-serviceca\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-kubelet\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5371b78-e249-4770-9029-8d8b46048db6-konnectivity-ca\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgx77\" (UniqueName: \"kubernetes.io/projected/15f13d54-560a-4da9-bb9f-4e60707e902b-kube-api-access-bgx77\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.717997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-os-release\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-bin\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718148 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cni-binary-copy\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-var-lib-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-env-overrides\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-system-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-daemon-config\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-multus-certs\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-etc-kubernetes\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15f13d54-560a-4da9-bb9f-4e60707e902b-host-slash\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-registration-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-sys-fs\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvd6\" (UniqueName: \"kubernetes.io/projected/e9279979-321e-45c8-9e80-033f7a537469-kube-api-access-ngvd6\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:02.718895 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cnibin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-os-release\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-socket-dir-parent\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-host\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718803    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.718906    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hhqkm\""
May 28 07:59:02.719621 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.719134    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 07:59:02.763341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.763304    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:54:01 +0000 UTC" deadline="2028-01-10 23:51:08.209945965 +0000 UTC"
May 28 07:59:02.763341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.763338    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14223h52m5.446611235s"
May 28 07:59:02.808117 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.808030    2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 07:59:02.810236 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.810193    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal" event={"ID":"0fa0fdf0c2348838da79ae1cda82e96b","Type":"ContainerStarted","Data":"2c366444a9d1f8f769d13d8829dfb37c9b55806e11e0dfd73231c70d1ccc6084"}
May 28 07:59:02.811452 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.811427    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal" event={"ID":"8943d242546d7e92f8c842fda362a274","Type":"ContainerStarted","Data":"0bef0ca02211a6a3ec5f6949a3d7d03d3591433ffa36bae51982715e22763643"}
May 28 07:59:02.819091 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819061    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.819225 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819109    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-registration-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.819225 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819145    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-sys-fs\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.819225 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819176    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvd6\" (UniqueName: \"kubernetes.io/projected/e9279979-321e-45c8-9e80-033f7a537469-kube-api-access-ngvd6\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.819225 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819198    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.819409 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819238    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.819409 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819305    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-sys-fs\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.819409 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819350    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:02.819409 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819390    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cnibin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819424    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-os-release\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819457    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-socket-dir-parent\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819490    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-host\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819522    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-socket-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819548    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-k8s-cni-cncf-io\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819578    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hxwb\" (UniqueName: \"kubernetes.io/projected/353ec337-7a4b-4f38-9bf6-b39f3aca7021-kube-api-access-6hxwb\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819631 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819608    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-systemd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819642    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819694    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819721    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819752    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-multus\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819783    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-conf-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819812    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819894    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-systemd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.819936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819939    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-registration-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819902    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-etc-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819967    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-socket-dir-parent\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819814    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-etc-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820037    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cnibin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820038    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-node-log\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820067    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-node-log\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820078    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819981    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820129    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-log-socket\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820135    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-k8s-cni-cncf-io\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820161    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-config\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820192    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010cd40a-b776-49aa-ae85-e932a37233b1-ovn-node-metrics-cert\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820205    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-conf-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820229    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-script-lib\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820273 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820236    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-multus\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.819897    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-os-release\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820466    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-socket-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820530    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-host\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820769    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820804    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51ecdec3-1e94-4b4e-9889-fe093d29749f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820833    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17fd3ad-bad2-4446-8856-471dd95615a6-hosts-file\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820910    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-script-lib\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.820957 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-run\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820967    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-log-socket\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.820970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp99t\" (UniqueName: \"kubernetes.io/projected/86e3227c-8954-49e1-9f64-f7d080c1b106-kube-api-access-vp99t\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821063    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-systemd-units\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821095    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-ovn\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821154    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-systemd-units\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821160    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-run-ovn\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17fd3ad-bad2-4446-8856-471dd95615a6-tmp-dir\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821204    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-ovnkube-config\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-var-lib-kubelet\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-host\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821293    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-kubelet\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821324    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15f13d54-560a-4da9-bb9f-4e60707e902b-iptables-alerter-script\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821327    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 07:59:02.821352 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821354    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-device-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821362    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-kubelet\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821379    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-bin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-kubernetes\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821435    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-device-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821443    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-cnibin\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821475    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-netd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821496    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-cni-bin\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-modprobe-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-systemd\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821546    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-cnibin\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-tmp\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821619    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-netd\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821625    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgjrl\" (UniqueName: \"kubernetes.io/projected/51ecdec3-1e94-4b4e-9889-fe093d29749f-kube-api-access-sgjrl\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821798    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-hostroot\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821831    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-slash\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821865    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821897    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15f13d54-560a-4da9-bb9f-4e60707e902b-iptables-alerter-script\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821903    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-hostroot\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-tuned\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821967    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-slash\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.821965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-797c6\" (UniqueName: \"kubernetes.io/projected/24788ad9-6968-4ee0-91be-fbb624852ddf-kube-api-access-797c6\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822018    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822035    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5371b78-e249-4770-9029-8d8b46048db6-agent-certs\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822066    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-netns\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822084    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6vh\" (UniqueName: \"kubernetes.io/projected/010cd40a-b776-49aa-ae85-e932a37233b1-kube-api-access-zp6vh\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysconfig\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822154    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfcm8\" (UniqueName: \"kubernetes.io/projected/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-kube-api-access-zfcm8\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822180    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-netns\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822151    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-run-netns\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822232    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-netns\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822287    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-serviceca\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822320    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-kubelet\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.822768 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822352    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5371b78-e249-4770-9029-8d8b46048db6-konnectivity-ca\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822381    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgx77\" (UniqueName: \"kubernetes.io/projected/15f13d54-560a-4da9-bb9f-4e60707e902b-kube-api-access-bgx77\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-conf\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-sys\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822479    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822513    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822539    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-os-release\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822593    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-bin\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822629    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cni-binary-copy\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822680    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822775    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-os-release\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.822845    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-system-cni-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823088    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5371b78-e249-4770-9029-8d8b46048db6-konnectivity-ca\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823124    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823138    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-var-lib-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823185    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-var-lib-openvswitch\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823178    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-env-overrides\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.823546 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wsv\" (UniqueName: \"kubernetes.io/projected/d17fd3ad-bad2-4446-8856-471dd95615a6-kube-api-access-f7wsv\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823244    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-var-lib-kubelet\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823283    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823319    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-system-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823365    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-daemon-config\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823399    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-multus-certs\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823426    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-etc-kubernetes\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823460    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15f13d54-560a-4da9-bb9f-4e60707e902b-host-slash\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-lib-modules\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823511    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51ecdec3-1e94-4b4e-9889-fe093d29749f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823693    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010cd40a-b776-49aa-ae85-e932a37233b1-env-overrides\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823842    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-system-cni-dir\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-host-run-multus-certs\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823956    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010cd40a-b776-49aa-ae85-e932a37233b1-host-cni-bin\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.824000    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-serviceca\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.824124    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/353ec337-7a4b-4f38-9bf6-b39f3aca7021-etc-kubernetes\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.823701    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9279979-321e-45c8-9e80-033f7a537469-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.824177    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15f13d54-560a-4da9-bb9f-4e60707e902b-host-slash\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.824403 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.824384    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-cni-binary-copy\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.825208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.824439    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/353ec337-7a4b-4f38-9bf6-b39f3aca7021-multus-daemon-config\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.825557 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.825532    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5371b78-e249-4770-9029-8d8b46048db6-agent-certs\") pod \"konnectivity-agent-ts8lq\" (UID: \"e5371b78-e249-4770-9029-8d8b46048db6\") " pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:02.825646 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.825562    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010cd40a-b776-49aa-ae85-e932a37233b1-ovn-node-metrics-cert\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.825732 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.825643    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:02.825732 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.825680    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:02.825732 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.825694    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:02.825870 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.825793    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:03.325754471 +0000 UTC m=+3.077227112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:02.827983 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.827960    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvd6\" (UniqueName: \"kubernetes.io/projected/e9279979-321e-45c8-9e80-033f7a537469-kube-api-access-ngvd6\") pod \"aws-ebs-csi-driver-node-kr6zh\" (UID: \"e9279979-321e-45c8-9e80-033f7a537469\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:02.828457 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.828390    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hxwb\" (UniqueName: \"kubernetes.io/projected/353ec337-7a4b-4f38-9bf6-b39f3aca7021-kube-api-access-6hxwb\") pod \"multus-sh5nm\" (UID: \"353ec337-7a4b-4f38-9bf6-b39f3aca7021\") " pod="openshift-multus/multus-sh5nm"
May 28 07:59:02.832791 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.832767    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgjrl\" (UniqueName: \"kubernetes.io/projected/51ecdec3-1e94-4b4e-9889-fe093d29749f-kube-api-access-sgjrl\") pod \"multus-additional-cni-plugins-jxsjb\" (UID: \"51ecdec3-1e94-4b4e-9889-fe093d29749f\") " pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:02.836198 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.836152    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6vh\" (UniqueName: \"kubernetes.io/projected/010cd40a-b776-49aa-ae85-e932a37233b1-kube-api-access-zp6vh\") pod \"ovnkube-node-h96rd\" (UID: \"010cd40a-b776-49aa-ae85-e932a37233b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:02.836309 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.836278    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgx77\" (UniqueName: \"kubernetes.io/projected/15f13d54-560a-4da9-bb9f-4e60707e902b-kube-api-access-bgx77\") pod \"iptables-alerter-hm562\" (UID: \"15f13d54-560a-4da9-bb9f-4e60707e902b\") " pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:02.836411 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.836389    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfcm8\" (UniqueName: \"kubernetes.io/projected/9eb1bba5-3eef-4610-a1d2-4ee55d20758c-kube-api-access-zfcm8\") pod \"node-ca-v2zms\" (UID: \"9eb1bba5-3eef-4610-a1d2-4ee55d20758c\") " pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:02.924870 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924616    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-modprobe-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924798    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-modprobe-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924888    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-systemd\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924917    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-tmp\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924947    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924971    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-tuned\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924999    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-797c6\" (UniqueName: \"kubernetes.io/projected/24788ad9-6968-4ee0-91be-fbb624852ddf-kube-api-access-797c6\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.925040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.924970    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-systemd\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925026    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysconfig\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925079    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysconfig\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925096    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-conf\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925132    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-sys\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925162    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wsv\" (UniqueName: \"kubernetes.io/projected/d17fd3ad-bad2-4446-8856-471dd95615a6-kube-api-access-f7wsv\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925094    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-d\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925188    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-lib-modules\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925211    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-sysctl-conf\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925224    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-sys\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925262    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17fd3ad-bad2-4446-8856-471dd95615a6-hosts-file\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925286    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-run\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925313    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp99t\" (UniqueName: \"kubernetes.io/projected/86e3227c-8954-49e1-9f64-f7d080c1b106-kube-api-access-vp99t\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925340    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.925383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925371    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17fd3ad-bad2-4446-8856-471dd95615a6-tmp-dir\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925388    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d17fd3ad-bad2-4446-8856-471dd95615a6-hosts-file\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925407    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-var-lib-kubelet\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925447    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-host\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925457    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-lib-modules\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925475    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-kubernetes\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.925492    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925524    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-var-lib-kubelet\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925547    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-kubernetes\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:02.925556    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:03.425536578 +0000 UTC m=+3.177009203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925580    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-run\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925595    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e3227c-8954-49e1-9f64-f7d080c1b106-host\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.926110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.925735    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17fd3ad-bad2-4446-8856-471dd95615a6-tmp-dir\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.927448 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.927409    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-tmp\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.927598 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.927574    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86e3227c-8954-49e1-9f64-f7d080c1b106-etc-tuned\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.933775 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.933727    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wsv\" (UniqueName: \"kubernetes.io/projected/d17fd3ad-bad2-4446-8856-471dd95615a6-kube-api-access-f7wsv\") pod \"node-resolver-x6h8q\" (UID: \"d17fd3ad-bad2-4446-8856-471dd95615a6\") " pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:02.934069 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.934048    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp99t\" (UniqueName: \"kubernetes.io/projected/86e3227c-8954-49e1-9f64-f7d080c1b106-kube-api-access-vp99t\") pod \"tuned-r4854\" (UID: \"86e3227c-8954-49e1-9f64-f7d080c1b106\") " pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:02.934146 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.934122    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-797c6\" (UniqueName: \"kubernetes.io/projected/24788ad9-6968-4ee0-91be-fbb624852ddf-kube-api-access-797c6\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:02.952324 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:02.952299    2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 07:59:03.005527 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.005486    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:03.016551 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.016519    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:03.023295 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.023268    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2zms"
May 28 07:59:03.029153 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.029124    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh"
May 28 07:59:03.036498 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.036477    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxsjb"
May 28 07:59:03.048121 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.048093    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hm562"
May 28 07:59:03.053752 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.053730    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sh5nm"
May 28 07:59:03.061451 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.061396    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r4854"
May 28 07:59:03.068120 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.068096    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x6h8q"
May 28 07:59:03.328119 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.328039    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:03.328287 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.328173    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:03.328287 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.328187    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:03.328287 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.328196    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:03.328287 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.328247    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:04.3282335 +0000 UTC m=+4.079706118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:03.429054 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.429015    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:03.429244 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.429193    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:03.429290 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.429273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:04.429253733 +0000 UTC m=+4.180726367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:03.706481 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.706450    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9279979_321e_45c8_9e80_033f7a537469.slice/crio-5f70da755b019c3c8f1f86cf7d7070c85ce00b89f8acc62f82f7d05747817029 WatchSource:0}: Error finding container 5f70da755b019c3c8f1f86cf7d7070c85ce00b89f8acc62f82f7d05747817029: Status 404 returned error can't find the container with id 5f70da755b019c3c8f1f86cf7d7070c85ce00b89f8acc62f82f7d05747817029
May 28 07:59:03.707188 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.707154    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5371b78_e249_4770_9029_8d8b46048db6.slice/crio-d37d70501c2ea1dc78abb0da376e2ef3b02850421cf43b43c1827c9b83ab79b4 WatchSource:0}: Error finding container d37d70501c2ea1dc78abb0da376e2ef3b02850421cf43b43c1827c9b83ab79b4: Status 404 returned error can't find the container with id d37d70501c2ea1dc78abb0da376e2ef3b02850421cf43b43c1827c9b83ab79b4
May 28 07:59:03.708037 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.707949    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010cd40a_b776_49aa_ae85_e932a37233b1.slice/crio-5b832e9e051704d65b7d1fcadab97508347660452644023b46f70d635afe2812 WatchSource:0}: Error finding container 5b832e9e051704d65b7d1fcadab97508347660452644023b46f70d635afe2812: Status 404 returned error can't find the container with id 5b832e9e051704d65b7d1fcadab97508347660452644023b46f70d635afe2812
May 28 07:59:03.708787 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.708762    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f13d54_560a_4da9_bb9f_4e60707e902b.slice/crio-0e1cf8a0a6cbb9aa8206f4373e3cab59d72cb3122d18fd15fe3fb02a6dc1f039 WatchSource:0}: Error finding container 0e1cf8a0a6cbb9aa8206f4373e3cab59d72cb3122d18fd15fe3fb02a6dc1f039: Status 404 returned error can't find the container with id 0e1cf8a0a6cbb9aa8206f4373e3cab59d72cb3122d18fd15fe3fb02a6dc1f039
May 28 07:59:03.712112 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.712089    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb1bba5_3eef_4610_a1d2_4ee55d20758c.slice/crio-5ebe81a6eb6dc16e5aec143f4b906bebd17986ee354672200dc40a8b6d8985a6 WatchSource:0}: Error finding container 5ebe81a6eb6dc16e5aec143f4b906bebd17986ee354672200dc40a8b6d8985a6: Status 404 returned error can't find the container with id 5ebe81a6eb6dc16e5aec143f4b906bebd17986ee354672200dc40a8b6d8985a6
May 28 07:59:03.714583 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.714558    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ecdec3_1e94_4b4e_9889_fe093d29749f.slice/crio-e2260eb5025ba9abf8975766b7d972f844f128e8753fe288762773cd029514c0 WatchSource:0}: Error finding container e2260eb5025ba9abf8975766b7d972f844f128e8753fe288762773cd029514c0: Status 404 returned error can't find the container with id e2260eb5025ba9abf8975766b7d972f844f128e8753fe288762773cd029514c0
May 28 07:59:03.716009 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.715799    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353ec337_7a4b_4f38_9bf6_b39f3aca7021.slice/crio-436b44161855707353e3d89c6171a3581eb876748f1796009353339b71aae102 WatchSource:0}: Error finding container 436b44161855707353e3d89c6171a3581eb876748f1796009353339b71aae102: Status 404 returned error can't find the container with id 436b44161855707353e3d89c6171a3581eb876748f1796009353339b71aae102
May 28 07:59:03.720459 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:03.720360    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e3227c_8954_49e1_9f64_f7d080c1b106.slice/crio-4d91ef6d12aeb3e19f82955e8ec3d02e9069ee8544022d8f5849d053438132a0 WatchSource:0}: Error finding container 4d91ef6d12aeb3e19f82955e8ec3d02e9069ee8544022d8f5849d053438132a0: Status 404 returned error can't find the container with id 4d91ef6d12aeb3e19f82955e8ec3d02e9069ee8544022d8f5849d053438132a0
May 28 07:59:03.764025 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.763991    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 07:54:01 +0000 UTC" deadline="2028-02-18 15:02:06.390823344 +0000 UTC"
May 28 07:59:03.764025 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.764019    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15151h3m2.626806538s"
May 28 07:59:03.807196 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.807171    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:03.807327 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:03.807297    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:03.814829 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.814778    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal" event={"ID":"0fa0fdf0c2348838da79ae1cda82e96b","Type":"ContainerStarted","Data":"75f17529d13cb2d469ba5acd3491e5b0cf047cef5b2293e118b411786500c038"}
May 28 07:59:03.815739 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.815717    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sh5nm" event={"ID":"353ec337-7a4b-4f38-9bf6-b39f3aca7021","Type":"ContainerStarted","Data":"436b44161855707353e3d89c6171a3581eb876748f1796009353339b71aae102"}
May 28 07:59:03.816705 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.816685    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerStarted","Data":"e2260eb5025ba9abf8975766b7d972f844f128e8753fe288762773cd029514c0"}
May 28 07:59:03.817600 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.817575    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2zms" event={"ID":"9eb1bba5-3eef-4610-a1d2-4ee55d20758c","Type":"ContainerStarted","Data":"5ebe81a6eb6dc16e5aec143f4b906bebd17986ee354672200dc40a8b6d8985a6"}
May 28 07:59:03.818587 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.818564    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hm562" event={"ID":"15f13d54-560a-4da9-bb9f-4e60707e902b","Type":"ContainerStarted","Data":"0e1cf8a0a6cbb9aa8206f4373e3cab59d72cb3122d18fd15fe3fb02a6dc1f039"}
May 28 07:59:03.819564 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.819541    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"5b832e9e051704d65b7d1fcadab97508347660452644023b46f70d635afe2812"}
May 28 07:59:03.820566 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.820547    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh" event={"ID":"e9279979-321e-45c8-9e80-033f7a537469","Type":"ContainerStarted","Data":"5f70da755b019c3c8f1f86cf7d7070c85ce00b89f8acc62f82f7d05747817029"}
May 28 07:59:03.821541 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.821512    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r4854" event={"ID":"86e3227c-8954-49e1-9f64-f7d080c1b106","Type":"ContainerStarted","Data":"4d91ef6d12aeb3e19f82955e8ec3d02e9069ee8544022d8f5849d053438132a0"}
May 28 07:59:03.822444 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.822425    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x6h8q" event={"ID":"d17fd3ad-bad2-4446-8856-471dd95615a6","Type":"ContainerStarted","Data":"1e95765bbc2b84d321071d8774e0073fd446fea366c09031ff5592a61c7871b8"}
May 28 07:59:03.823268 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.823249    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ts8lq" event={"ID":"e5371b78-e249-4770-9029-8d8b46048db6","Type":"ContainerStarted","Data":"d37d70501c2ea1dc78abb0da376e2ef3b02850421cf43b43c1827c9b83ab79b4"}
May 28 07:59:03.827383 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:03.827347    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-246.ec2.internal" podStartSLOduration=1.827336297 podStartE2EDuration="1.827336297s" podCreationTimestamp="2026-05-28 07:59:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:59:03.827205278 +0000 UTC m=+3.578677919" watchObservedRunningTime="2026-05-28 07:59:03.827336297 +0000 UTC m=+3.578808937"
May 28 07:59:04.337333 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:04.337186    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:04.337497 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.337381    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:04.337497 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.337407    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:04.337497 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.337421    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:04.337497 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.337488    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:06.337468858 +0000 UTC m=+6.088941482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:04.438543 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:04.437964    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:04.438543 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.438117    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:04.438543 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.438183    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:06.438164568 +0000 UTC m=+6.189637200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:04.811668 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:04.811125    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:04.811668 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:04.811260    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:04.845485 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:04.844241    2560 generic.go:358] "Generic (PLEG): container finished" podID="8943d242546d7e92f8c842fda362a274" containerID="943e35389c3c158538273afbf91ca9c0d342070dcbf198f69876df274fde0208" exitCode=0
May 28 07:59:04.845485 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:04.845184    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal" event={"ID":"8943d242546d7e92f8c842fda362a274","Type":"ContainerDied","Data":"943e35389c3c158538273afbf91ca9c0d342070dcbf198f69876df274fde0208"}
May 28 07:59:05.807254 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:05.807221    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:05.807457 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:05.807353    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:05.866561 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:05.865871    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal" event={"ID":"8943d242546d7e92f8c842fda362a274","Type":"ContainerStarted","Data":"63197df94e942669a406d666e24edf230b9544f1ce199a2235f288d98800e270"}
May 28 07:59:06.352644 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:06.351999    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:06.352644 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.352206    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:06.352644 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.352229    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:06.352644 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.352242    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:06.352644 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.352301    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:10.352282035 +0000 UTC m=+10.103754659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:06.452959 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:06.452914    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:06.453140 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.453038    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:06.453140 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.453086    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:10.453074058 +0000 UTC m=+10.204546682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:06.807134 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:06.806616    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:06.807134 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:06.806776    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:07.806350 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:07.806306    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:07.806909 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:07.806450    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:08.359115 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.358189    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-246.ec2.internal" podStartSLOduration=6.358168735 podStartE2EDuration="6.358168735s" podCreationTimestamp="2026-05-28 07:59:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 07:59:05.880846652 +0000 UTC m=+5.632319294" watchObservedRunningTime="2026-05-28 07:59:08.358168735 +0000 UTC m=+8.109641377"
May 28 07:59:08.359115 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.358566    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rb6bw"]
May 28 07:59:08.361598 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.361349    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.361598 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:08.361435    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:08.470673 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.470608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-kubelet-config\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.470837 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.470680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-dbus\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.470837 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.470728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.571614 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.571564    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.571793 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.571695    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-kubelet-config\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.571793 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.571726    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-dbus\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.571922 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.571899    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-dbus\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.572078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:08.572009    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:08.572078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:08.572067    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:09.072047753 +0000 UTC m=+8.823520377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:08.572330 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.572282    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f675a40-07fe-4d17-b358-d0ff493f069a-kubelet-config\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:08.807828 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:08.807745    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:08.808294 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:08.807898    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:09.076161 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:09.076068    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:09.076333 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:09.076270    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:09.076394 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:09.076368    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:10.076346206 +0000 UTC m=+9.827818827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:09.806882 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:09.806848    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:09.807065 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:09.806848    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:09.807065 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:09.806985    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:09.807143 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:09.807072    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:10.084054 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:10.083898    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:10.084488 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.084054    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:10.084488 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.084129    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:12.084107955 +0000 UTC m=+11.835580597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:10.386917 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:10.386780    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:10.387078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.386944    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:10.387078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.386965    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:10.387078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.386976    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:10.387078 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.387029    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:18.387015539 +0000 UTC m=+18.138488159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:10.487761 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:10.487721    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:10.487952 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.487855    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:10.487952 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.487926    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:18.48790699 +0000 UTC m=+18.239379609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:10.807790 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:10.807203    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:10.807790 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:10.807327    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:11.806758 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:11.806649    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:11.807210 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:11.806797    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:11.807277 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:11.807251    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:11.807388 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:11.807346    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:12.103092 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:12.102989    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:12.103255 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:12.103153    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:12.103255 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:12.103228    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:16.10320722 +0000 UTC m=+15.854679851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:12.806616 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:12.806577    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:12.806803 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:12.806741    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:13.806851 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:13.806818    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:13.807195 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:13.806818    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:13.807195 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:13.806928    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:13.807195 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:13.806986    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:14.810040 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:14.810011    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:14.810468 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:14.810148    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:15.807202 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:15.807166    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:15.807369 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:15.807166    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:15.807369 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:15.807300    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:15.807502 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:15.807376    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:16.133014 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:16.132927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:16.133463 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:16.133091    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:16.133463 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:16.133174    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:24.133155078 +0000 UTC m=+23.884627913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:16.806437 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:16.806408    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:16.806614 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:16.806548    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:17.806707 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:17.806627    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:17.807193 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:17.806779    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:17.807193 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:17.806843    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:17.807193 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:17.806955    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:18.447987 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:18.447944    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:18.448839 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.448413    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:18.448839 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.448473    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:18.448839 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.448488    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:18.448839 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.448558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:34.448537621 +0000 UTC m=+34.200010257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:18.548889 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:18.548853    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:18.549062 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.548980    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:18.549062 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.549049    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 07:59:34.549029579 +0000 UTC m=+34.300502213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:18.810360 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:18.810274    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:18.810802 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:18.810406    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:19.806932 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:19.806899    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:19.807112 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:19.806933    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:19.807112 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:19.807015    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:19.807216 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:19.807153    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:20.807615 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:20.807586    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:20.807990 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:20.807708    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:21.806845 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:21.806806    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:21.807070 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:21.806806    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:21.807070 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:21.806918    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:21.807070 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:21.806976    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:22.806731 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.806418    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:22.807600 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:22.806976    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:22.895557 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.895527    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sh5nm" event={"ID":"353ec337-7a4b-4f38-9bf6-b39f3aca7021","Type":"ContainerStarted","Data":"2cae700c105324d803106ddef819e36da4f843df7857c78d221ba0790fd21e9b"}
May 28 07:59:22.900991 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.900962    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="7d555da443bf2ad0b671179a5ac34e343358ab92a40da4040f0a17176d457513" exitCode=0
May 28 07:59:22.901110 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.901031    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"7d555da443bf2ad0b671179a5ac34e343358ab92a40da4040f0a17176d457513"}
May 28 07:59:22.902234 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.902211    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2zms" event={"ID":"9eb1bba5-3eef-4610-a1d2-4ee55d20758c","Type":"ContainerStarted","Data":"87ef2327cacf8fb43c02add3b2c972ce84a479305fe479580eff98435fa0da3a"}
May 28 07:59:22.904341 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.904316    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"364523f1730c2706aaed96e8670728f12e155422599a848377e7db201a6db1e9"}
May 28 07:59:22.904439 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.904347    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"ae7eda890a35009d93ac99695eeedbfb71c56be7aeadb9d857e88c4135d39654"}
May 28 07:59:22.904439 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.904361    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"95c818546268099e5c3b253e16181ad3306000b089dcd5a76123a5dcf153c883"}
May 28 07:59:22.904439 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.904373    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"b1cdf98f65f68e74e0b5b4746d61f47fda681f47f71c62d990896ce828c891aa"}
May 28 07:59:22.905624 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.905577    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh" event={"ID":"e9279979-321e-45c8-9e80-033f7a537469","Type":"ContainerStarted","Data":"62e904dd9f8578a482991e585a159a9613f0249ed809c58c277298ffaeff0ca4"}
May 28 07:59:22.908644 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.907497    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r4854" event={"ID":"86e3227c-8954-49e1-9f64-f7d080c1b106","Type":"ContainerStarted","Data":"3da4a01a64772f10c5d7126977266220e57354616fcdf4a10ca97fa87da214e5"}
May 28 07:59:22.909954 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.909917    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x6h8q" event={"ID":"d17fd3ad-bad2-4446-8856-471dd95615a6","Type":"ContainerStarted","Data":"8cfcdc3f7655dbb3804daaf9166aef0335708efe513863a3ac1707acac83fc2f"}
May 28 07:59:22.911210 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.911188    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ts8lq" event={"ID":"e5371b78-e249-4770-9029-8d8b46048db6","Type":"ContainerStarted","Data":"cccf47710110b38798e2840df9fdab49a038f3c8af30f079cb448c6b8f850828"}
May 28 07:59:22.937285 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.937247    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-x6h8q" podStartSLOduration=3.497737708 podStartE2EDuration="21.937230699s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.720517943 +0000 UTC m=+3.471990575" lastFinishedPulling="2026-05-28 07:59:22.160010935 +0000 UTC m=+21.911483566" observedRunningTime="2026-05-28 07:59:22.936836231 +0000 UTC m=+22.688308871" watchObservedRunningTime="2026-05-28 07:59:22.937230699 +0000 UTC m=+22.688703340"
May 28 07:59:22.937419 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.937400    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-sh5nm" podStartSLOduration=3.466093146 podStartE2EDuration="21.93739597s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.7188159 +0000 UTC m=+3.470288526" lastFinishedPulling="2026-05-28 07:59:22.190118723 +0000 UTC m=+21.941591350" observedRunningTime="2026-05-28 07:59:22.920271313 +0000 UTC m=+22.671743957" watchObservedRunningTime="2026-05-28 07:59:22.93739597 +0000 UTC m=+22.688868611"
May 28 07:59:22.949924 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.949880    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v2zms" podStartSLOduration=8.309360332 podStartE2EDuration="22.949864069s" podCreationTimestamp="2026-05-28 07:59:00 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.713755433 +0000 UTC m=+3.465228051" lastFinishedPulling="2026-05-28 07:59:18.354259168 +0000 UTC m=+18.105731788" observedRunningTime="2026-05-28 07:59:22.949704595 +0000 UTC m=+22.701177236" watchObservedRunningTime="2026-05-28 07:59:22.949864069 +0000 UTC m=+22.701336710"
May 28 07:59:22.966076 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.966019    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r4854" podStartSLOduration=3.5268179870000003 podStartE2EDuration="21.966004348s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.721545376 +0000 UTC m=+3.473017995" lastFinishedPulling="2026-05-28 07:59:22.160731732 +0000 UTC m=+21.912204356" observedRunningTime="2026-05-28 07:59:22.965396922 +0000 UTC m=+22.716869562" watchObservedRunningTime="2026-05-28 07:59:22.966004348 +0000 UTC m=+22.717476992"
May 28 07:59:22.981208 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:22.981163    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ts8lq" podStartSLOduration=4.53235375 podStartE2EDuration="22.981146008s" podCreationTimestamp="2026-05-28 07:59:00 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.710165448 +0000 UTC m=+3.461638072" lastFinishedPulling="2026-05-28 07:59:22.15895771 +0000 UTC m=+21.910430330" observedRunningTime="2026-05-28 07:59:22.980911891 +0000 UTC m=+22.732384534" watchObservedRunningTime="2026-05-28 07:59:22.981146008 +0000 UTC m=+22.732618653"
May 28 07:59:23.753919 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.753888    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 07:59:23.789732 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.789610    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T07:59:23.753914255Z","UUID":"6215cce1-c48e-4861-9ef0-f61e81d242e1","Handler":null,"Name":"","Endpoint":""}
May 28 07:59:23.791290 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.791138    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 07:59:23.791393 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.791296    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 07:59:23.806834 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.806808    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:23.807164 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.806847    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:23.807164 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:23.806938    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:23.807252 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:23.807198    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:23.914359 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.914315    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hm562" event={"ID":"15f13d54-560a-4da9-bb9f-4e60707e902b","Type":"ContainerStarted","Data":"c78bbf093b57a6cac2472effc287182cf23594f01bd5171b310517e9966e53fc"}
May 28 07:59:23.917228 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.917194    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"a0bdd27bdae31deef3350ea5396b8657ce00fd827afbec740526be222425f699"}
May 28 07:59:23.917228 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.917226    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"4522355d2a20f444950ddb8fcfa4fa9dca669df08e2d28dcd210838e66dea547"}
May 28 07:59:23.918919 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.918828    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh" event={"ID":"e9279979-321e-45c8-9e80-033f7a537469","Type":"ContainerStarted","Data":"f9e116a53a50dc817773c918e05ff400823fd4aa95b22c898ad708b910461e5e"}
May 28 07:59:23.927936 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:23.927891    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hm562" podStartSLOduration=4.479378276 podStartE2EDuration="22.927877594s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.711238844 +0000 UTC m=+3.462711467" lastFinishedPulling="2026-05-28 07:59:22.159738162 +0000 UTC m=+21.911210785" observedRunningTime="2026-05-28 07:59:23.927643105 +0000 UTC m=+23.679115747" watchObservedRunningTime="2026-05-28 07:59:23.927877594 +0000 UTC m=+23.679350236"
May 28 07:59:24.197073 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:24.197037    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:24.197260 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:24.197185    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 07:59:24.197325 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:24.197264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret podName:7f675a40-07fe-4d17-b358-d0ff493f069a nodeName:}" failed. No retries permitted until 2026-05-28 07:59:40.197243196 +0000 UTC m=+39.948715836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret") pod "global-pull-secret-syncer-rb6bw" (UID: "7f675a40-07fe-4d17-b358-d0ff493f069a") : object "kube-system"/"original-pull-secret" not registered
May 28 07:59:24.806833 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:24.806803    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:24.806978 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:24.806949    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:24.923130 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:24.923096    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh" event={"ID":"e9279979-321e-45c8-9e80-033f7a537469","Type":"ContainerStarted","Data":"7b2231914415e3681667a5eaf796c64acb742642d076de55c307840d7fac01b0"}
May 28 07:59:24.939488 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:24.939441    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr6zh" podStartSLOduration=3.8709930200000002 podStartE2EDuration="24.939427446s" podCreationTimestamp="2026-05-28 07:59:00 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.708310773 +0000 UTC m=+3.459783396" lastFinishedPulling="2026-05-28 07:59:24.77674519 +0000 UTC m=+24.528217822" observedRunningTime="2026-05-28 07:59:24.939328703 +0000 UTC m=+24.690801344" watchObservedRunningTime="2026-05-28 07:59:24.939427446 +0000 UTC m=+24.690900086"
May 28 07:59:25.742098 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:25.742062    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:25.742598 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:25.742578    2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:25.806995 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:25.806965    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:25.806995 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:25.806979    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:25.807475 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:25.807072    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:25.807475 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:25.807204    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:25.928729 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:25.928695    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"7fbdf1432db2bbbe57cf756f7b2417cf66326797de322f6c6ce8f9bb47663aaa"}
May 28 07:59:26.807132 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:26.807093    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:26.807847 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:26.807231    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:27.807276 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.807100    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:27.807607 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.807100    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:27.807607 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:27.807345    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:27.807607 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:27.807420    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:27.933634 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.933598    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="9b30cfe9ec9f1961233f873d33c51ed787ec1b62e7066ffd4f0cc9861e448ad6" exitCode=0
May 28 07:59:27.933835 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.933696    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"9b30cfe9ec9f1961233f873d33c51ed787ec1b62e7066ffd4f0cc9861e448ad6"}
May 28 07:59:27.936848 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.936823    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" event={"ID":"010cd40a-b776-49aa-ae85-e932a37233b1","Type":"ContainerStarted","Data":"cc1bd8b3737f20462d0fee08c7b1f91b341214297f298dc82905ce3b2d64d5d0"}
May 28 07:59:27.937192 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.937173    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:27.937286 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.937212    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:27.937286 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.937226    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:27.952358 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.952332    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:27.952466 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.952409    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 07:59:27.977605 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:27.976295    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd" podStartSLOduration=9.280568019 podStartE2EDuration="27.976279439s" podCreationTimestamp="2026-05-28 07:59:00 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.710997591 +0000 UTC m=+3.462470212" lastFinishedPulling="2026-05-28 07:59:22.406709004 +0000 UTC m=+22.158181632" observedRunningTime="2026-05-28 07:59:27.97585633 +0000 UTC m=+27.727328974" watchObservedRunningTime="2026-05-28 07:59:27.976279439 +0000 UTC m=+27.727752082"
May 28 07:59:28.806477 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:28.806325    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:28.806477 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:28.806461    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:28.940547 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:28.940515    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="da41cf049d54586939d9817b576477ce723e7de68a6a01defbcae5988cad4e2a" exitCode=0
May 28 07:59:28.940943 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:28.940606    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"da41cf049d54586939d9817b576477ce723e7de68a6a01defbcae5988cad4e2a"}
May 28 07:59:29.521094 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.521055    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92x5x"]
May 28 07:59:29.521262 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.521188    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:29.521366 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:29.521280    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:29.523843 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.523815    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rw9j6"]
May 28 07:59:29.523947 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.523920    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:29.524059 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:29.524038    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:29.526831 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.526807    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rb6bw"]
May 28 07:59:29.526940 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.526914    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:29.527002 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:29.526985    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:29.944562 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.944528    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="8af7fc90aae6d5c4c9b1a38b538fe8f98fc28bb85712c8a9f7120a0118fa9a02" exitCode=0
May 28 07:59:29.944927 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:29.944615    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"8af7fc90aae6d5c4c9b1a38b538fe8f98fc28bb85712c8a9f7120a0118fa9a02"}
May 28 07:59:30.807012 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:30.806984    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:30.807167 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:30.807083    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:30.807167 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:30.807104    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:30.807167 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:30.807115    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:30.807288 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:30.807202    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:30.807288 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:30.807276    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:31.604779 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:31.604455    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:31.605220 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:31.604819    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 07:59:31.605220 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:31.605075    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ts8lq"
May 28 07:59:32.806525 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:32.806491    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:32.807004 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:32.806491    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:32.807004 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:32.806735    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:32.807004 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:32.806613    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:32.807004 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:32.806491    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:32.807004 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:32.806814    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:34.479865 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:34.479823    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:34.480405 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.479952    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 07:59:34.480405 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.479975    2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 07:59:34.480405 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.479985    2560 projected.go:194] Error preparing data for projected volume kube-api-access-thbqz for pod openshift-network-diagnostics/network-check-target-92x5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:34.480405 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.480041    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz podName:b87584bb-c0bb-4c1c-b863-76b005ac3129 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:06.480024787 +0000 UTC m=+66.231497418 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-thbqz" (UniqueName: "kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz") pod "network-check-target-92x5x" (UID: "b87584bb-c0bb-4c1c-b863-76b005ac3129") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 07:59:34.580265 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:34.580230    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:34.580446 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.580376    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:34.580446 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.580444    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 08:00:06.580423708 +0000 UTC m=+66.331896340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 07:59:34.806691 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:34.806593    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:34.806691 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:34.806597    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:34.806930 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.806733    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rb6bw" podUID="7f675a40-07fe-4d17-b358-d0ff493f069a"
May 28 07:59:34.806930 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:34.806597    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:34.806930 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.806904    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92x5x" podUID="b87584bb-c0bb-4c1c-b863-76b005ac3129"
May 28 07:59:34.807079 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:34.806768    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 07:59:36.069503 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.069427    2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-246.ec2.internal" event="NodeReady"
May 28 07:59:36.070108 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.069570    2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 07:59:36.101543 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.101505    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"]
May 28 07:59:36.123303 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.123272    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-854dbc79b4-lwngh"]
May 28 07:59:36.123469 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.123437    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.126100 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.126062    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 07:59:36.126246 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.126184    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 07:59:36.126308 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.126255    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g6jcs\""
May 28 07:59:36.137948 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.137428    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"]
May 28 07:59:36.137948 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.137567    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.140340 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.140321    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 07:59:36.140502 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.140488    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 07:59:36.140861 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.140686    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 07:59:36.140861 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.140710    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxgfh\""
May 28 07:59:36.155159 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.155133    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"]
May 28 07:59:36.155284 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.155269    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.158053 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.158031    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 07:59:36.158164 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.158091    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 07:59:36.158164 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.158106    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 07:59:36.158261 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.158186    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 07:59:36.158261 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.158228    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m5rxn\""
May 28 07:59:36.159472 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.159452    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 07:59:36.165281 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.165261    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"]
May 28 07:59:36.165410 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.165392    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.167721 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.167705    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 07:59:36.177360 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177340    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"]
May 28 07:59:36.177471 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177368    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"]
May 28 07:59:36.177471 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177403    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854dbc79b4-lwngh"]
May 28 07:59:36.177471 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177418    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"]
May 28 07:59:36.177471 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177433    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6vjq5"]
May 28 07:59:36.177640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.177599    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.180157 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.179978    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 28 07:59:36.180157 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.180020    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 28 07:59:36.180326 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.180252    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 28 07:59:36.180326 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.180291    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 28 07:59:36.191390 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.191372    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"]
May 28 07:59:36.191390 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.191393    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6vjq5"]
May 28 07:59:36.191557 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.191514    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.200207 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.200184    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 07:59:36.200301 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.200275    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 07:59:36.200367 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.200327    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47xg9\""
May 28 07:59:36.200428 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.200387    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 07:59:36.226691 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.225169    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cgnw6"]
May 28 07:59:36.241444 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.241419    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cgnw6"]
May 28 07:59:36.241576 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.241550    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.244038 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.243995    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hh68\""
May 28 07:59:36.244038 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.244021    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 07:59:36.244212 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.244161    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 07:59:36.291886 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.291860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d54e4595-8b3f-4c16-8d56-38d8029a3cff-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.292002 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.291891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/25ad1548-aa16-4151-8fef-e78c781d4844-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292002 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.291912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292002 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.291966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.292002 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.291985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.292205 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292205 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292205 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f8c4ef2-303f-4b16-8bb0-039e4392038a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.292205 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46bxn\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292205 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64kd7\" (UniqueName: \"kubernetes.io/projected/7f8c4ef2-303f-4b16-8bb0-039e4392038a-kube-api-access-64kd7\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lj7\" (UniqueName: \"kubernetes.io/projected/7d051ba8-4737-4372-b17b-bbf9c9463a40-kube-api-access-46lj7\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292387 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgq5c\" (UniqueName: \"kubernetes.io/projected/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-kube-api-access-pgq5c\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjk2\" (UniqueName: \"kubernetes.io/projected/25ad1548-aa16-4151-8fef-e78c781d4844-kube-api-access-2jjk2\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.292594 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.292515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8c4ef2-303f-4b16-8bb0-039e4392038a-tmp\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.393224 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393195    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.393399 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d1ceba-aa14-4a10-a971-baac94d0e263-config-volume\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.393399 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393252    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.393399 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393271    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64kd7\" (UniqueName: \"kubernetes.io/projected/7f8c4ef2-303f-4b16-8bb0-039e4392038a-kube-api-access-64kd7\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.393399 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzl6q\" (UniqueName: \"kubernetes.io/projected/99d1ceba-aa14-4a10-a971-baac94d0e263-kube-api-access-tzl6q\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.393399 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.393342    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.393416    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 07:59:36.893398031 +0000 UTC m=+36.644870650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393346    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393488    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393546    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393570    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjk2\" (UniqueName: \"kubernetes.io/projected/25ad1548-aa16-4151-8fef-e78c781d4844-kube-api-access-2jjk2\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.393640 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393591    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393694    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d54e4595-8b3f-4c16-8d56-38d8029a3cff-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393727    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393767    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393796    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f8c4ef2-303f-4b16-8bb0-039e4392038a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393829    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46lj7\" (UniqueName: \"kubernetes.io/projected/7d051ba8-4737-4372-b17b-bbf9c9463a40-kube-api-access-46lj7\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.393863    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393868    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.393922    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:36.893904417 +0000 UTC m=+36.645377047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393942    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgq5c\" (UniqueName: \"kubernetes.io/projected/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-kube-api-access-pgq5c\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.393975    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394028 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d1ceba-aa14-4a10-a971-baac94d0e263-tmp-dir\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394037    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394067    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394097    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394124    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8c4ef2-303f-4b16-8bb0-039e4392038a-tmp\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394154    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/25ad1548-aa16-4151-8fef-e78c781d4844-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394180    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394210    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46bxn\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394389    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d54e4595-8b3f-4c16-8d56-38d8029a3cff-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.394463 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.394421    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.395435 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.395142    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:36.395435 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.395160    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:36.395435 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.395211    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 07:59:36.895196839 +0000 UTC m=+36.646669458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:36.395435 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.395398    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.396093 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.395805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f8c4ef2-303f-4b16-8bb0-039e4392038a-tmp\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.396093 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.395851    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.398705 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.398681    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.398816 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.398713    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.398816 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.398739    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.398816 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.398756    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f8c4ef2-303f-4b16-8bb0-039e4392038a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.398816 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.398743    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.399031 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.399000    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.399031 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.399017    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.399128 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.399031    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25ad1548-aa16-4151-8fef-e78c781d4844-hub\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.404127 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.404088    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/25ad1548-aa16-4151-8fef-e78c781d4844-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.404602 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.404577    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjk2\" (UniqueName: \"kubernetes.io/projected/25ad1548-aa16-4151-8fef-e78c781d4844-kube-api-access-2jjk2\") pod \"cluster-proxy-proxy-agent-7fcb4d97db-dnpkj\" (UID: \"25ad1548-aa16-4151-8fef-e78c781d4844\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.404801 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.404749    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.405368 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.405344    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lj7\" (UniqueName: \"kubernetes.io/projected/7d051ba8-4737-4372-b17b-bbf9c9463a40-kube-api-access-46lj7\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.405803 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.405787    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46bxn\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.405970 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.405950    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgq5c\" (UniqueName: \"kubernetes.io/projected/71f8dfe2-5550-451b-a88d-2bb97f6fb4e4-kube-api-access-pgq5c\") pod \"managed-serviceaccount-addon-agent-78cbbd67bd-hbst9\" (UID: \"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.412167 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.412147    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64kd7\" (UniqueName: \"kubernetes.io/projected/7f8c4ef2-303f-4b16-8bb0-039e4392038a-kube-api-access-64kd7\") pod \"klusterlet-addon-workmgr-5b69b44c5f-m29zg\" (UID: \"7f8c4ef2-303f-4b16-8bb0-039e4392038a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.476492 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.476474    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"
May 28 07:59:36.486570 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.486545    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:36.490944 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.490850    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 07:59:36.494723 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.494705    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d1ceba-aa14-4a10-a971-baac94d0e263-tmp-dir\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.494809 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.494762    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d1ceba-aa14-4a10-a971-baac94d0e263-config-volume\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.494809 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.494800    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzl6q\" (UniqueName: \"kubernetes.io/projected/99d1ceba-aa14-4a10-a971-baac94d0e263-kube-api-access-tzl6q\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.494915 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.494855    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.494993 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.494977    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:36.495067 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.495056    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:36.995037644 +0000 UTC m=+36.746510276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:36.495122 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.495084    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99d1ceba-aa14-4a10-a971-baac94d0e263-tmp-dir\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.496448 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.495856    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99d1ceba-aa14-4a10-a971-baac94d0e263-config-volume\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.506929 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.506903    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzl6q\" (UniqueName: \"kubernetes.io/projected/99d1ceba-aa14-4a10-a971-baac94d0e263-kube-api-access-tzl6q\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:36.659330 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.659237    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9"]
May 28 07:59:36.662368 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.662342    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"]
May 28 07:59:36.672726 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.672704    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"]
May 28 07:59:36.675552 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:36.675521    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8c4ef2_303f_4b16_8bb0_039e4392038a.slice/crio-ebc96b0a6da949048dc2036c6c231b3e09a84df1bace2011cc1c1343e732b091 WatchSource:0}: Error finding container ebc96b0a6da949048dc2036c6c231b3e09a84df1bace2011cc1c1343e732b091: Status 404 returned error can't find the container with id ebc96b0a6da949048dc2036c6c231b3e09a84df1bace2011cc1c1343e732b091
May 28 07:59:36.676166 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:36.676139    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f8dfe2_5550_451b_a88d_2bb97f6fb4e4.slice/crio-1a46622183fe44985b0c2acfc5c4baf26407e0df4f1fbbbfd324a1b7c4a5da7e WatchSource:0}: Error finding container 1a46622183fe44985b0c2acfc5c4baf26407e0df4f1fbbbfd324a1b7c4a5da7e: Status 404 returned error can't find the container with id 1a46622183fe44985b0c2acfc5c4baf26407e0df4f1fbbbfd324a1b7c4a5da7e
May 28 07:59:36.677210 ip-10-0-141-246 kubenswrapper[2560]: W0528 07:59:36.677186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25ad1548_aa16_4151_8fef_e78c781d4844.slice/crio-e2bdaded6ae7a9dd99207fdf76ea7e458de7d79cbc14a3a979e2066b0e0d06da WatchSource:0}: Error finding container e2bdaded6ae7a9dd99207fdf76ea7e458de7d79cbc14a3a979e2066b0e0d06da: Status 404 returned error can't find the container with id e2bdaded6ae7a9dd99207fdf76ea7e458de7d79cbc14a3a979e2066b0e0d06da
May 28 07:59:36.809603 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.809577    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 07:59:36.809752 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.809578    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 07:59:36.809752 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.809696    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:36.812937 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.812885    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 07:59:36.812937 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.812917    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9jcs\""
May 28 07:59:36.813138 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.812943    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 07:59:36.813138 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.812972    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 07:59:36.813138 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.812919    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 07:59:36.813138 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.813020    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxd67\""
May 28 07:59:36.899878 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.899843    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.899900    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.899941    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900015    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900042    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900053    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:36.900061 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900066    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:36.900283 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900090    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:37.900070049 +0000 UTC m=+37.651542687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:36.900283 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 07:59:37.900100142 +0000 UTC m=+37.651572761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:36.900283 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:36.900126    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 07:59:37.900117525 +0000 UTC m=+37.651590144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:36.960441 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.960358    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="5b56b37c110a29d95df317cf354022608d0e5381e02f50b03088e63f69c62e90" exitCode=0
May 28 07:59:36.960581 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.960453    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"5b56b37c110a29d95df317cf354022608d0e5381e02f50b03088e63f69c62e90"}
May 28 07:59:36.962065 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.962041    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerStarted","Data":"e2bdaded6ae7a9dd99207fdf76ea7e458de7d79cbc14a3a979e2066b0e0d06da"}
May 28 07:59:36.963120 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.963088    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" event={"ID":"7f8c4ef2-303f-4b16-8bb0-039e4392038a","Type":"ContainerStarted","Data":"ebc96b0a6da949048dc2036c6c231b3e09a84df1bace2011cc1c1343e732b091"}
May 28 07:59:36.964021 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:36.964000    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9" event={"ID":"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4","Type":"ContainerStarted","Data":"1a46622183fe44985b0c2acfc5c4baf26407e0df4f1fbbbfd324a1b7c4a5da7e"}
May 28 07:59:37.001185 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.001138    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:37.001336 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.001317    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:37.001408 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.001384    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:38.001366449 +0000 UTC m=+37.752839084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:37.909102 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.909054    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.909121    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.909210    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909370    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909428    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:39.909411682 +0000 UTC m=+39.660884320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909701    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:37.909741 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909723    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:37.910063 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909778    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:37.910063 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909783    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 07:59:39.909764777 +0000 UTC m=+39.661237403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:37.910063 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:37.909852    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 07:59:39.90983432 +0000 UTC m=+39.661306942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:37.970393 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.970362    2560 generic.go:358] "Generic (PLEG): container finished" podID="51ecdec3-1e94-4b4e-9889-fe093d29749f" containerID="03c3200c1ffc717c2d12ba2785244be15d839c5e18216e33bbf991fdcf094117" exitCode=0
May 28 07:59:37.970545 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:37.970442    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerDied","Data":"03c3200c1ffc717c2d12ba2785244be15d839c5e18216e33bbf991fdcf094117"}
May 28 07:59:38.011133 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:38.011103    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:38.011311 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:38.011282    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:38.011524 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:38.011350    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:40.011329539 +0000 UTC m=+39.762802178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:38.978152 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:38.977893    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" event={"ID":"51ecdec3-1e94-4b4e-9889-fe093d29749f","Type":"ContainerStarted","Data":"2e8ead3e30b0a6f23d59387b3f20d6f59e739847c241ef4dccf61e94981eb030"}
May 28 07:59:39.001368 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:39.001297    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxsjb" podStartSLOduration=5.261962028 podStartE2EDuration="38.001276738s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 07:59:03.718891667 +0000 UTC m=+3.470364286" lastFinishedPulling="2026-05-28 07:59:36.458206373 +0000 UTC m=+36.209678996" observedRunningTime="2026-05-28 07:59:38.999103107 +0000 UTC m=+38.750575751" watchObservedRunningTime="2026-05-28 07:59:39.001276738 +0000 UTC m=+38.752749379"
May 28 07:59:39.930213 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:39.930176    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:39.930405 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:39.930263    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:39.930405 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:39.930311    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:39.930515 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930490    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:39.930709 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930558    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 07:59:43.930537535 +0000 UTC m=+43.682010157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:39.930709 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930633    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:39.930973 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930740    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:39.930973 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930752    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:39.930973 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930793    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 07:59:43.930777588 +0000 UTC m=+43.682250208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:39.930973 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:39.930853    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:43.930832289 +0000 UTC m=+43.682304908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:40.031918 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:40.031867    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:40.032375 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:40.032008    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:40.032375 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:40.032085    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:44.032069051 +0000 UTC m=+43.783541692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:40.233000 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:40.232917    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:40.237356 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:40.237322    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f675a40-07fe-4d17-b358-d0ff493f069a-original-pull-secret\") pod \"global-pull-secret-syncer-rb6bw\" (UID: \"7f675a40-07fe-4d17-b358-d0ff493f069a\") " pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:40.429866 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:40.429836    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rb6bw"
May 28 07:59:43.969704 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:43.969650    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:43.969773    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969804    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:43.969829    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969878    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 07:59:51.96986228 +0000 UTC m=+51.721334900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969907    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969939    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969954    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.969968    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:51.969954606 +0000 UTC m=+51.721427230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:43.970133 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:43.970005    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 07:59:51.969991754 +0000 UTC m=+51.721464373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:44.070931 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.070896    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:44.071083 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:44.071043    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:44.071123 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:44.071101    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 07:59:52.071086527 +0000 UTC m=+51.822559146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:44.415554 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.415523    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rb6bw"]
May 28 07:59:44.990287 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.990249    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rb6bw" event={"ID":"7f675a40-07fe-4d17-b358-d0ff493f069a","Type":"ContainerStarted","Data":"c98ab1d9419cbbad4139edb644a19b7f23c139bb600bbea89caaefdd3f450450"}
May 28 07:59:44.991748 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.991718    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" event={"ID":"7f8c4ef2-303f-4b16-8bb0-039e4392038a","Type":"ContainerStarted","Data":"fe1ec9c4074c49a85a75e7c3f259435313a2d2ff1ae765cac543fac2c569ecde"}
May 28 07:59:44.992043 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.991991    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:44.993282 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.993237    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9" event={"ID":"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4","Type":"ContainerStarted","Data":"8915448ed1088e5849eb42c59f15bd8176c3004ac19b5fa1b6af1ddd6a1881f5"}
May 28 07:59:44.993994 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.993976    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 07:59:44.994776 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:44.994752    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerStarted","Data":"4f25d8c4ee04f671542fddf662ee3f8299263d24a1d8a3e34c0a11658cc1ae8c"}
May 28 07:59:45.008078 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:45.008033    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" podStartSLOduration=19.41355847 podStartE2EDuration="27.008021249s" podCreationTimestamp="2026-05-28 07:59:18 +0000 UTC" firstStartedPulling="2026-05-28 07:59:36.677788906 +0000 UTC m=+36.429261539" lastFinishedPulling="2026-05-28 07:59:44.272251699 +0000 UTC m=+44.023724318" observedRunningTime="2026-05-28 07:59:45.006216388 +0000 UTC m=+44.757689029" watchObservedRunningTime="2026-05-28 07:59:45.008021249 +0000 UTC m=+44.759493890"
May 28 07:59:45.019926 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:45.019884    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9" podStartSLOduration=19.442825266 podStartE2EDuration="27.019873918s" podCreationTimestamp="2026-05-28 07:59:18 +0000 UTC" firstStartedPulling="2026-05-28 07:59:36.678219161 +0000 UTC m=+36.429691779" lastFinishedPulling="2026-05-28 07:59:44.255267797 +0000 UTC m=+44.006740431" observedRunningTime="2026-05-28 07:59:45.019131613 +0000 UTC m=+44.770604254" watchObservedRunningTime="2026-05-28 07:59:45.019873918 +0000 UTC m=+44.771346558"
May 28 07:59:49.007325 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:49.007297    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerStarted","Data":"c473f801eb4087199b8d7e66c190d73fa99afa41e33c1973444dedf1593a4ab4"}
May 28 07:59:50.011883 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:50.011847    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerStarted","Data":"f257abf07eb041cd774dd2f40222810820843cd75228d16598b4f3c7254e6d5c"}
May 28 07:59:50.013109 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:50.013079    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rb6bw" event={"ID":"7f675a40-07fe-4d17-b358-d0ff493f069a","Type":"ContainerStarted","Data":"ee0cbde5f77842d6dcdd157098875b774dd9420557b406534f321022db1458ae"}
May 28 07:59:50.029808 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:50.029770    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" podStartSLOduration=19.969956433 podStartE2EDuration="32.029758297s" podCreationTimestamp="2026-05-28 07:59:18 +0000 UTC" firstStartedPulling="2026-05-28 07:59:36.679447401 +0000 UTC m=+36.430920020" lastFinishedPulling="2026-05-28 07:59:48.739249265 +0000 UTC m=+48.490721884" observedRunningTime="2026-05-28 07:59:50.029514457 +0000 UTC m=+49.780987098" watchObservedRunningTime="2026-05-28 07:59:50.029758297 +0000 UTC m=+49.781230939"
May 28 07:59:50.043049 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:50.043006    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rb6bw" podStartSLOduration=37.510861087 podStartE2EDuration="42.042994707s" podCreationTimestamp="2026-05-28 07:59:08 +0000 UTC" firstStartedPulling="2026-05-28 07:59:44.421900073 +0000 UTC m=+44.173372692" lastFinishedPulling="2026-05-28 07:59:48.954033691 +0000 UTC m=+48.705506312" observedRunningTime="2026-05-28 07:59:50.042375314 +0000 UTC m=+49.793847977" watchObservedRunningTime="2026-05-28 07:59:50.042994707 +0000 UTC m=+49.794467347"
May 28 07:59:52.038882 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:52.038850    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:52.038895    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:52.038945    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.038991    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039008    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039020    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039061    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.039044816 +0000 UTC m=+67.790517435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.039068091 +0000 UTC m=+67.790540710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039085    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 07:59:52.039396 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.039155    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.039136469 +0000 UTC m=+67.790609091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 07:59:52.140155 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:52.140124    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 07:59:52.140295 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.140226    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 07:59:52.140295 ip-10-0-141-246 kubenswrapper[2560]: E0528 07:59:52.140277    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:08.140262332 +0000 UTC m=+67.891734951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 07:59:59.959628 ip-10-0-141-246 kubenswrapper[2560]: I0528 07:59:59.959600    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h96rd"
May 28 08:00:06.551075 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.551036    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 08:00:06.553693 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.553673    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 08:00:06.563766 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.563744    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 08:00:06.574016 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.573995    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thbqz\" (UniqueName: \"kubernetes.io/projected/b87584bb-c0bb-4c1c-b863-76b005ac3129-kube-api-access-thbqz\") pod \"network-check-target-92x5x\" (UID: \"b87584bb-c0bb-4c1c-b863-76b005ac3129\") " pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 08:00:06.652266 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.652240    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:00:06.655188 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.655169    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 08:00:06.663188 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:06.663169    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 08:00:06.663273 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:06.663222    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 08:01:10.663207245 +0000 UTC m=+130.414679864 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : secret "metrics-daemon-secret" not found
May 28 08:00:06.821821 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.821744    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxd67\""
May 28 08:00:06.829880 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.829856    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 08:00:06.948534 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:06.948393    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92x5x"]
May 28 08:00:06.950817 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:00:06.950792    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87584bb_c0bb_4c1c_b863_76b005ac3129.slice/crio-1063c3c99fc7fcd73ecf46cbbc0e9f198a140ffb1cbf2682e3d1f988bb71021e WatchSource:0}: Error finding container 1063c3c99fc7fcd73ecf46cbbc0e9f198a140ffb1cbf2682e3d1f988bb71021e: Status 404 returned error can't find the container with id 1063c3c99fc7fcd73ecf46cbbc0e9f198a140ffb1cbf2682e3d1f988bb71021e
May 28 08:00:07.057133 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:07.057080    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92x5x" event={"ID":"b87584bb-c0bb-4c1c-b863-76b005ac3129","Type":"ContainerStarted","Data":"1063c3c99fc7fcd73ecf46cbbc0e9f198a140ffb1cbf2682e3d1f988bb71021e"}
May 28 08:00:08.062554 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:08.062524    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:00:08.062554 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:08.062567    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:08.062612    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062701    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062726    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062748    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062766    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062780    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:40.062759719 +0000 UTC m=+99.814232339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062800    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 08:00:40.062790207 +0000 UTC m=+99.814262826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 08:00:08.063136 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.062815    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 08:00:40.062807185 +0000 UTC m=+99.814279804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 08:00:08.163347 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:08.163308    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 08:00:08.163582 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.163482    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 08:00:08.163582 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:08.163559    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 08:00:40.163538115 +0000 UTC m=+99.915010733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 08:00:11.066793 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:11.066760    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92x5x" event={"ID":"b87584bb-c0bb-4c1c-b863-76b005ac3129","Type":"ContainerStarted","Data":"d5bc110319a808f0381dabedecb3637cccc9e286d76946e46bd9b4112e1ac48d"}
May 28 08:00:11.067191 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:11.066883    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 08:00:11.081890 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:11.081848    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-92x5x" podStartSLOduration=66.848194952 podStartE2EDuration="1m10.081835897s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 08:00:06.952792937 +0000 UTC m=+66.704265557" lastFinishedPulling="2026-05-28 08:00:10.186433883 +0000 UTC m=+69.937906502" observedRunningTime="2026-05-28 08:00:11.080982104 +0000 UTC m=+70.832454744" watchObservedRunningTime="2026-05-28 08:00:11.081835897 +0000 UTC m=+70.833308567"
May 28 08:00:40.118527 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:40.118483    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:00:40.118527 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:40.118534    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:40.118562    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118642    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118692    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118699    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118716    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118741    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:44.11872307 +0000 UTC m=+163.870195694 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118761    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 08:01:44.11874737 +0000 UTC m=+163.870219993 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 08:00:40.119017 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.118774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 08:01:44.118767804 +0000 UTC m=+163.870240423 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 08:00:40.219350 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:40.219304    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 08:00:40.219512 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.219458    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 08:00:40.219551 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:00:40.219516    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 08:01:44.219499929 +0000 UTC m=+163.970972554 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 08:00:42.071794 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:00:42.071761    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-92x5x"
May 28 08:01:10.741105 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:10.741059    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:01:10.741606 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:10.741214    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 08:01:10.741606 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:10.741285    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs podName:24788ad9-6968-4ee0-91be-fbb624852ddf nodeName:}" failed. No retries permitted until 2026-05-28 08:03:12.741267631 +0000 UTC m=+252.492740250 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs") pod "network-metrics-daemon-rw9j6" (UID: "24788ad9-6968-4ee0-91be-fbb624852ddf") : secret "metrics-daemon-secret" not found
May 28 08:01:39.136694 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:39.136614    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg" podUID="d54e4595-8b3f-4c16-8d56-38d8029a3cff"
May 28 08:01:39.148733 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:39.148701    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh" podUID="9e063a38-b48e-4571-94c2-c4d49745d55e"
May 28 08:01:39.210312 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:39.210279    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6vjq5" podUID="7d051ba8-4737-4372-b17b-bbf9c9463a40"
May 28 08:01:39.251607 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:39.251571    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cgnw6" podUID="99d1ceba-aa14-4a10-a971-baac94d0e263"
May 28 08:01:39.272364 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:39.272337    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:01:39.272475 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:39.272337    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:01:39.825425 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:39.825369    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rw9j6" podUID="24788ad9-6968-4ee0-91be-fbb624852ddf"
May 28 08:01:44.198185 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:44.198146    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:44.198221    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:44.198247    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") pod \"image-registry-854dbc79b4-lwngh\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") " pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198293    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198333    2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198344    2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854dbc79b4-lwngh: secret "image-registry-tls" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198349    2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198384    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert podName:d54e4595-8b3f-4c16-8d56-38d8029a3cff nodeName:}" failed. No retries permitted until 2026-05-28 08:03:46.198369028 +0000 UTC m=+285.949841647 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-lwsfg" (UID: "d54e4595-8b3f-4c16-8d56-38d8029a3cff") : secret "networking-console-plugin-cert" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198400    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls podName:9e063a38-b48e-4571-94c2-c4d49745d55e nodeName:}" failed. No retries permitted until 2026-05-28 08:03:46.19839303 +0000 UTC m=+285.949865649 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls") pod "image-registry-854dbc79b4-lwngh" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e") : secret "image-registry-tls" not found
May 28 08:01:44.198576 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.198409    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert podName:7d051ba8-4737-4372-b17b-bbf9c9463a40 nodeName:}" failed. No retries permitted until 2026-05-28 08:03:46.198404297 +0000 UTC m=+285.949876915 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert") pod "ingress-canary-6vjq5" (UID: "7d051ba8-4737-4372-b17b-bbf9c9463a40") : secret "canary-serving-cert" not found
May 28 08:01:44.299259 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:44.299229    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 08:01:44.299424 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.299368    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 08:01:44.299472 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:01:44.299431    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls podName:99d1ceba-aa14-4a10-a971-baac94d0e263 nodeName:}" failed. No retries permitted until 2026-05-28 08:03:46.299416825 +0000 UTC m=+286.050889444 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls") pod "dns-default-cgnw6" (UID: "99d1ceba-aa14-4a10-a971-baac94d0e263") : secret "dns-default-metrics-tls" not found
May 28 08:01:44.992434 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:44.992392    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" podUID="7f8c4ef2-303f-4b16-8bb0-039e4392038a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 28 08:01:45.288769 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.288678    2560 generic.go:358] "Generic (PLEG): container finished" podID="7f8c4ef2-303f-4b16-8bb0-039e4392038a" containerID="fe1ec9c4074c49a85a75e7c3f259435313a2d2ff1ae765cac543fac2c569ecde" exitCode=1
May 28 08:01:45.288769 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.288686    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" event={"ID":"7f8c4ef2-303f-4b16-8bb0-039e4392038a","Type":"ContainerDied","Data":"fe1ec9c4074c49a85a75e7c3f259435313a2d2ff1ae765cac543fac2c569ecde"}
May 28 08:01:45.289278 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.289121    2560 scope.go:117] "RemoveContainer" containerID="fe1ec9c4074c49a85a75e7c3f259435313a2d2ff1ae765cac543fac2c569ecde"
May 28 08:01:45.289954 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.289933    2560 generic.go:358] "Generic (PLEG): container finished" podID="71f8dfe2-5550-451b-a88d-2bb97f6fb4e4" containerID="8915448ed1088e5849eb42c59f15bd8176c3004ac19b5fa1b6af1ddd6a1881f5" exitCode=255
May 28 08:01:45.290008 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.289988    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9" event={"ID":"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4","Type":"ContainerDied","Data":"8915448ed1088e5849eb42c59f15bd8176c3004ac19b5fa1b6af1ddd6a1881f5"}
May 28 08:01:45.290316 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.290299    2560 scope.go:117] "RemoveContainer" containerID="8915448ed1088e5849eb42c59f15bd8176c3004ac19b5fa1b6af1ddd6a1881f5"
May 28 08:01:45.954513 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:45.954484    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x6h8q_d17fd3ad-bad2-4446-8856-471dd95615a6/dns-node-resolver/0.log"
May 28 08:01:46.293561 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:46.293480    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg" event={"ID":"7f8c4ef2-303f-4b16-8bb0-039e4392038a","Type":"ContainerStarted","Data":"9b40d466732aab0385ec6b2923fd115d7a3bd787e4084b468370248a60359180"}
May 28 08:01:46.294006 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:46.293792    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 08:01:46.294440 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:46.294421    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b69b44c5f-m29zg"
May 28 08:01:46.295109 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:46.295092    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78cbbd67bd-hbst9" event={"ID":"71f8dfe2-5550-451b-a88d-2bb97f6fb4e4","Type":"ContainerStarted","Data":"188483e909057da6bd9be719aa37a3da95d0b9df4229977f7f091431463458d3"}
May 28 08:01:47.154093 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:47.154061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2zms_9eb1bba5-3eef-4610-a1d2-4ee55d20758c/node-ca/0.log"
May 28 08:01:51.807209 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:51.807124    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cgnw6"
May 28 08:01:53.806900 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:53.806855    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:01:54.806338 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:01:54.806301    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:02:03.620769 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.620733    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-st2m4"]
May 28 08:02:03.623777 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.623758    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.627286 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.627264    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 08:02:03.627411 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.627392    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 08:02:03.628116 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.628097    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 08:02:03.628223 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.628097    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 08:02:03.628690 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.628652    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j77x8\""
May 28 08:02:03.634533 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.634512    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st2m4"]
May 28 08:02:03.655090 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.655059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c71d45-8958-4c56-a884-1b15e7267586-data-volume\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.655242 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.655136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bhw9\" (UniqueName: \"kubernetes.io/projected/e2c71d45-8958-4c56-a884-1b15e7267586-kube-api-access-8bhw9\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.655242 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.655226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2c71d45-8958-4c56-a884-1b15e7267586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.655328 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.655257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2c71d45-8958-4c56-a884-1b15e7267586-crio-socket\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.655328 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.655279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2c71d45-8958-4c56-a884-1b15e7267586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756286 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756253    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2c71d45-8958-4c56-a884-1b15e7267586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756286 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756291    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2c71d45-8958-4c56-a884-1b15e7267586-crio-socket\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756494 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756313    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2c71d45-8958-4c56-a884-1b15e7267586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756494 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756370    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c71d45-8958-4c56-a884-1b15e7267586-data-volume\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756494 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756387    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2c71d45-8958-4c56-a884-1b15e7267586-crio-socket\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756494 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756415    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bhw9\" (UniqueName: \"kubernetes.io/projected/e2c71d45-8958-4c56-a884-1b15e7267586-kube-api-access-8bhw9\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756825 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2c71d45-8958-4c56-a884-1b15e7267586-data-volume\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.756926 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.756908    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2c71d45-8958-4c56-a884-1b15e7267586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.758535 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.758520    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2c71d45-8958-4c56-a884-1b15e7267586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.781107 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.781080    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bhw9\" (UniqueName: \"kubernetes.io/projected/e2c71d45-8958-4c56-a884-1b15e7267586-kube-api-access-8bhw9\") pod \"insights-runtime-extractor-st2m4\" (UID: \"e2c71d45-8958-4c56-a884-1b15e7267586\") " pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:03.932678 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:03.932567    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-st2m4"
May 28 08:02:04.056205 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:04.056176    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-st2m4"]
May 28 08:02:04.059407 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:02:04.059382    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c71d45_8958_4c56_a884_1b15e7267586.slice/crio-82fc6a18a5b60953f3151d5383774aaf0306000bba9af51f2903239182560a69 WatchSource:0}: Error finding container 82fc6a18a5b60953f3151d5383774aaf0306000bba9af51f2903239182560a69: Status 404 returned error can't find the container with id 82fc6a18a5b60953f3151d5383774aaf0306000bba9af51f2903239182560a69
May 28 08:02:04.336403 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:04.336320    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st2m4" event={"ID":"e2c71d45-8958-4c56-a884-1b15e7267586","Type":"ContainerStarted","Data":"3b5e8ad947fbda91bc1d00c252bf2fa064293bdd08a22008aa6f2dcaef510ca2"}
May 28 08:02:04.336403 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:04.336357    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st2m4" event={"ID":"e2c71d45-8958-4c56-a884-1b15e7267586","Type":"ContainerStarted","Data":"82fc6a18a5b60953f3151d5383774aaf0306000bba9af51f2903239182560a69"}
May 28 08:02:05.340524 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:05.340484    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st2m4" event={"ID":"e2c71d45-8958-4c56-a884-1b15e7267586","Type":"ContainerStarted","Data":"0254f6c10436f1a50a548d539502b2433d082394a5f8b31add0382762c79174f"}
May 28 08:02:06.350372 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:06.350293    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-st2m4" event={"ID":"e2c71d45-8958-4c56-a884-1b15e7267586","Type":"ContainerStarted","Data":"89fa86c60604c4e766aefb7a995ac75b72630aac55a21821ff4233ecea5c78ba"}
May 28 08:02:06.367730 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:06.367688    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-st2m4" podStartSLOduration=1.4897850080000001 podStartE2EDuration="3.367676006s" podCreationTimestamp="2026-05-28 08:02:03 +0000 UTC" firstStartedPulling="2026-05-28 08:02:04.118871436 +0000 UTC m=+183.870344055" lastFinishedPulling="2026-05-28 08:02:05.996762434 +0000 UTC m=+185.748235053" observedRunningTime="2026-05-28 08:02:06.366534647 +0000 UTC m=+186.118007289" watchObservedRunningTime="2026-05-28 08:02:06.367676006 +0000 UTC m=+186.119148647"
May 28 08:02:16.491993 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:16.491956    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" podUID="25ad1548-aa16-4151-8fef-e78c781d4844" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 08:02:21.608905 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.608873    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwl54"]
May 28 08:02:21.612093 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.612076    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.615342 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.615315    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 08:02:21.615487 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.615472    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 08:02:21.615568 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.615536    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 08:02:21.615609 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.615569    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 08:02:21.616624 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.616603    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 08:02:21.616624 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.616613    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bks6g\""
May 28 08:02:21.616825 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.616645    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 08:02:21.686513 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-wtmp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-textfile\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-sys\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-metrics-client-ca\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq8qp\" (UniqueName: \"kubernetes.io/projected/b7c9c01e-725c-484a-970e-fcc1e697f5ed-kube-api-access-pq8qp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.686750 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-root\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.687010 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.686761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787425 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787381    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-wtmp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787441    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-textfile\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787473    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-sys\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787503    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787535    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787557    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-metrics-client-ca\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787578    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-sys\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787581    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq8qp\" (UniqueName: \"kubernetes.io/projected/b7c9c01e-725c-484a-970e-fcc1e697f5ed-kube-api-access-pq8qp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787555    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-wtmp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:02:21.787697    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787723    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-root\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787689    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7c9c01e-725c-484a-970e-fcc1e697f5ed-root\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:02:21.787756    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls podName:b7c9c01e-725c-484a-970e-fcc1e697f5ed nodeName:}" failed. No retries permitted until 2026-05-28 08:02:22.287736854 +0000 UTC m=+202.039209489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls") pod "node-exporter-nwl54" (UID: "b7c9c01e-725c-484a-970e-fcc1e697f5ed") : secret "node-exporter-tls" not found
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787841    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-textfile\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.787927 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.787843    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.788208 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.788178    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-metrics-client-ca\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.788259 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.788230    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.789880 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.789859    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:21.795786 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:21.795767    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq8qp\" (UniqueName: \"kubernetes.io/projected/b7c9c01e-725c-484a-970e-fcc1e697f5ed-kube-api-access-pq8qp\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:22.292027 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:22.291988    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:22.294218 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:22.294200    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7c9c01e-725c-484a-970e-fcc1e697f5ed-node-exporter-tls\") pod \"node-exporter-nwl54\" (UID: \"b7c9c01e-725c-484a-970e-fcc1e697f5ed\") " pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:22.520691 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:22.520641    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwl54"
May 28 08:02:22.529181 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:02:22.529156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c9c01e_725c_484a_970e_fcc1e697f5ed.slice/crio-405e0941848bc5e273764a70e88ae272e0b916603e7f5cfd0410b19d2da3d25e WatchSource:0}: Error finding container 405e0941848bc5e273764a70e88ae272e0b916603e7f5cfd0410b19d2da3d25e: Status 404 returned error can't find the container with id 405e0941848bc5e273764a70e88ae272e0b916603e7f5cfd0410b19d2da3d25e
May 28 08:02:23.390979 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:23.390941    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwl54" event={"ID":"b7c9c01e-725c-484a-970e-fcc1e697f5ed","Type":"ContainerStarted","Data":"405e0941848bc5e273764a70e88ae272e0b916603e7f5cfd0410b19d2da3d25e"}
May 28 08:02:24.394953 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:24.394917    2560 generic.go:358] "Generic (PLEG): container finished" podID="b7c9c01e-725c-484a-970e-fcc1e697f5ed" containerID="0285e18c5398357cacea84c3ce7091ff1e4dec5817592cf39c0e19a4c92b42ff" exitCode=0
May 28 08:02:24.395337 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:24.394963    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwl54" event={"ID":"b7c9c01e-725c-484a-970e-fcc1e697f5ed","Type":"ContainerDied","Data":"0285e18c5398357cacea84c3ce7091ff1e4dec5817592cf39c0e19a4c92b42ff"}
May 28 08:02:25.399087 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:25.399048    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwl54" event={"ID":"b7c9c01e-725c-484a-970e-fcc1e697f5ed","Type":"ContainerStarted","Data":"a79defcbcac01f4f9c2d744d868e53f9801e50823dc9ba89e44c94f217633f8b"}
May 28 08:02:25.399087 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:25.399087    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwl54" event={"ID":"b7c9c01e-725c-484a-970e-fcc1e697f5ed","Type":"ContainerStarted","Data":"2bb352ea6bbb139d1124d4252d26300d04a17212e1991c2eeeec70cfd3891185"}
May 28 08:02:25.419675 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:25.419612    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwl54" podStartSLOduration=3.485389239 podStartE2EDuration="4.419598136s" podCreationTimestamp="2026-05-28 08:02:21 +0000 UTC" firstStartedPulling="2026-05-28 08:02:22.531015081 +0000 UTC m=+202.282487700" lastFinishedPulling="2026-05-28 08:02:23.465223968 +0000 UTC m=+203.216696597" observedRunningTime="2026-05-28 08:02:25.417577527 +0000 UTC m=+205.169050167" watchObservedRunningTime="2026-05-28 08:02:25.419598136 +0000 UTC m=+205.171070778"
May 28 08:02:25.738680 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:25.738570    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854dbc79b4-lwngh"]
May 28 08:02:25.738843 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:02:25.738818    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh" podUID="9e063a38-b48e-4571-94c2-c4d49745d55e"
May 28 08:02:26.401589 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.401558    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:02:26.405774 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.405752    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:02:26.492172 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.492138    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" podUID="25ad1548-aa16-4151-8fef-e78c781d4844" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 08:02:26.524760 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524729    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.524930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524778    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.524930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524809    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.524930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524844    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.524930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524871    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.524930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524905    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46bxn\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.525186 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.524937    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates\") pod \"9e063a38-b48e-4571-94c2-c4d49745d55e\" (UID: \"9e063a38-b48e-4571-94c2-c4d49745d55e\") "
May 28 08:02:26.525238 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.525213    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 08:02:26.525580 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.525554    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 08:02:26.525779 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.525754    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 08:02:26.527233 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.527199    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 08:02:26.527328 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.527237    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn" (OuterVolumeSpecName: "kube-api-access-46bxn") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "kube-api-access-46bxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:02:26.527397 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.527382    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:02:26.527616 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.527596    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e063a38-b48e-4571-94c2-c4d49745d55e" (UID: "9e063a38-b48e-4571-94c2-c4d49745d55e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 08:02:26.626368 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626337    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-trusted-ca\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626368 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626365    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-image-registry-private-configuration\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626368 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626377    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e063a38-b48e-4571-94c2-c4d49745d55e-installation-pull-secrets\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626596 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626387    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-bound-sa-token\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626596 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626396    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e063a38-b48e-4571-94c2-c4d49745d55e-ca-trust-extracted\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626596 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626404    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46bxn\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-kube-api-access-46bxn\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:26.626596 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:26.626413    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-certificates\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:27.403410 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:27.403378    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854dbc79b4-lwngh"
May 28 08:02:27.437840 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:27.437794    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854dbc79b4-lwngh"]
May 28 08:02:27.445931 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:27.445906    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-854dbc79b4-lwngh"]
May 28 08:02:27.533485 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:27.533453    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e063a38-b48e-4571-94c2-c4d49745d55e-registry-tls\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:02:28.810263 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:28.810227    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e063a38-b48e-4571-94c2-c4d49745d55e" path="/var/lib/kubelet/pods/9e063a38-b48e-4571-94c2-c4d49745d55e/volumes"
May 28 08:02:36.491975 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:36.491929    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" podUID="25ad1548-aa16-4151-8fef-e78c781d4844" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 08:02:36.492344 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:36.492002    2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj"
May 28 08:02:36.492606 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:36.492564    2560 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f257abf07eb041cd774dd2f40222810820843cd75228d16598b4f3c7254e6d5c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 28 08:02:36.492643 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:36.492630    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" podUID="25ad1548-aa16-4151-8fef-e78c781d4844" containerName="service-proxy" containerID="cri-o://f257abf07eb041cd774dd2f40222810820843cd75228d16598b4f3c7254e6d5c" gracePeriod=30
May 28 08:02:37.428616 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:37.428580    2560 generic.go:358] "Generic (PLEG): container finished" podID="25ad1548-aa16-4151-8fef-e78c781d4844" containerID="f257abf07eb041cd774dd2f40222810820843cd75228d16598b4f3c7254e6d5c" exitCode=2
May 28 08:02:37.428835 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:37.428665    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerDied","Data":"f257abf07eb041cd774dd2f40222810820843cd75228d16598b4f3c7254e6d5c"}
May 28 08:02:37.428835 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:37.428711    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fcb4d97db-dnpkj" event={"ID":"25ad1548-aa16-4151-8fef-e78c781d4844","Type":"ContainerStarted","Data":"00a983e67af94086ebd19ff9780901a111911bb9d0234f433d297127a0c12179"}
May 28 08:02:59.747804 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:02:59.747776    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x6h8q_d17fd3ad-bad2-4446-8856-471dd95615a6/dns-node-resolver/0.log"
May 28 08:03:12.785410 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:12.785369    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:03:12.787597 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:12.787573    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24788ad9-6968-4ee0-91be-fbb624852ddf-metrics-certs\") pod \"network-metrics-daemon-rw9j6\" (UID: \"24788ad9-6968-4ee0-91be-fbb624852ddf\") " pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:03:12.809105 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:12.809076    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9jcs\""
May 28 08:03:12.817338 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:12.817316    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw9j6"
May 28 08:03:12.938771 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:12.938735    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rw9j6"]
May 28 08:03:12.942070 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:03:12.942040    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24788ad9_6968_4ee0_91be_fbb624852ddf.slice/crio-74187b06cf58bafd8cde59fa9d0cd8e79486e563ec4417dec69423227518ee15 WatchSource:0}: Error finding container 74187b06cf58bafd8cde59fa9d0cd8e79486e563ec4417dec69423227518ee15: Status 404 returned error can't find the container with id 74187b06cf58bafd8cde59fa9d0cd8e79486e563ec4417dec69423227518ee15
May 28 08:03:13.518743 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:13.518701    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw9j6" event={"ID":"24788ad9-6968-4ee0-91be-fbb624852ddf","Type":"ContainerStarted","Data":"74187b06cf58bafd8cde59fa9d0cd8e79486e563ec4417dec69423227518ee15"}
May 28 08:03:14.524059 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:14.524022    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw9j6" event={"ID":"24788ad9-6968-4ee0-91be-fbb624852ddf","Type":"ContainerStarted","Data":"8e748deb903f3f2544e30510a0a8ef7137dd3214accad419a150d9c968d8e18a"}
May 28 08:03:14.524059 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:14.524057    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw9j6" event={"ID":"24788ad9-6968-4ee0-91be-fbb624852ddf","Type":"ContainerStarted","Data":"afda639f79f9e0679fddda50d81855ea921985301e9cdfb760ae0d869985fc3a"}
May 28 08:03:14.540028 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:14.539983    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rw9j6" podStartSLOduration=252.497125318 podStartE2EDuration="4m13.539969511s" podCreationTimestamp="2026-05-28 07:59:01 +0000 UTC" firstStartedPulling="2026-05-28 08:03:12.943747731 +0000 UTC m=+252.695220349" lastFinishedPulling="2026-05-28 08:03:13.986591923 +0000 UTC m=+253.738064542" observedRunningTime="2026-05-28 08:03:14.538412196 +0000 UTC m=+254.289884836" watchObservedRunningTime="2026-05-28 08:03:14.539969511 +0000 UTC m=+254.291442152"
May 28 08:03:42.273117 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:03:42.273062    2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg" podUID="d54e4595-8b3f-4c16-8d56-38d8029a3cff"
May 28 08:03:42.597819 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:42.597740    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:03:46.232546 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.232501    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:03:46.233147 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.232585    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:03:46.234943 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.234917    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d54e4595-8b3f-4c16-8d56-38d8029a3cff-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-lwsfg\" (UID: \"d54e4595-8b3f-4c16-8d56-38d8029a3cff\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:03:46.235046 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.234957    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d051ba8-4737-4372-b17b-bbf9c9463a40-cert\") pod \"ingress-canary-6vjq5\" (UID: \"7d051ba8-4737-4372-b17b-bbf9c9463a40\") " pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:03:46.309877 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.309841    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47xg9\""
May 28 08:03:46.318000 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.317975    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6vjq5"
May 28 08:03:46.333033 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.333002    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 08:03:46.335273 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.335245    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99d1ceba-aa14-4a10-a971-baac94d0e263-metrics-tls\") pod \"dns-default-cgnw6\" (UID: \"99d1ceba-aa14-4a10-a971-baac94d0e263\") " pod="openshift-dns/dns-default-cgnw6"
May 28 08:03:46.411389 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.411286    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hh68\""
May 28 08:03:46.418499 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.418466    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cgnw6"
May 28 08:03:46.446712 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.446673    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6vjq5"]
May 28 08:03:46.449427 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:03:46.449399    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d051ba8_4737_4372_b17b_bbf9c9463a40.slice/crio-4a03919538fa0f8db3f857858bfdf43ec3b7f6a302c2c1fb3c27b3b6bcbfd108 WatchSource:0}: Error finding container 4a03919538fa0f8db3f857858bfdf43ec3b7f6a302c2c1fb3c27b3b6bcbfd108: Status 404 returned error can't find the container with id 4a03919538fa0f8db3f857858bfdf43ec3b7f6a302c2c1fb3c27b3b6bcbfd108
May 28 08:03:46.501808 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.501779    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g6jcs\""
May 28 08:03:46.509957 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.509932    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"
May 28 08:03:46.543139 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.543100    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cgnw6"]
May 28 08:03:46.545807 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:03:46.545780    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d1ceba_aa14_4a10_a971_baac94d0e263.slice/crio-b01f5d2466045d19682b4665c9176e9ec9ef9fe9ac3d3be1a01ea16c00e452c6 WatchSource:0}: Error finding container b01f5d2466045d19682b4665c9176e9ec9ef9fe9ac3d3be1a01ea16c00e452c6: Status 404 returned error can't find the container with id b01f5d2466045d19682b4665c9176e9ec9ef9fe9ac3d3be1a01ea16c00e452c6
May 28 08:03:46.609020 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.608984    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6vjq5" event={"ID":"7d051ba8-4737-4372-b17b-bbf9c9463a40","Type":"ContainerStarted","Data":"4a03919538fa0f8db3f857858bfdf43ec3b7f6a302c2c1fb3c27b3b6bcbfd108"}
May 28 08:03:46.610001 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.609977    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cgnw6" event={"ID":"99d1ceba-aa14-4a10-a971-baac94d0e263","Type":"ContainerStarted","Data":"b01f5d2466045d19682b4665c9176e9ec9ef9fe9ac3d3be1a01ea16c00e452c6"}
May 28 08:03:46.635890 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:46.635856    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg"]
May 28 08:03:46.638681 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:03:46.638636    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54e4595_8b3f_4c16_8d56_38d8029a3cff.slice/crio-6c70ee192e8f7d01eeba866a7ce60b43264139179b7e5e5542eac73358151e25 WatchSource:0}: Error finding container 6c70ee192e8f7d01eeba866a7ce60b43264139179b7e5e5542eac73358151e25: Status 404 returned error can't find the container with id 6c70ee192e8f7d01eeba866a7ce60b43264139179b7e5e5542eac73358151e25
May 28 08:03:47.614883 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:47.614844    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg" event={"ID":"d54e4595-8b3f-4c16-8d56-38d8029a3cff","Type":"ContainerStarted","Data":"6c70ee192e8f7d01eeba866a7ce60b43264139179b7e5e5542eac73358151e25"}
May 28 08:03:48.620866 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:48.620830    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg" event={"ID":"d54e4595-8b3f-4c16-8d56-38d8029a3cff","Type":"ContainerStarted","Data":"26ede912ae1ec3a01bbcf41f987cd4ced5f96e0d13f95a989e4d71d8365121c1"}
May 28 08:03:48.637193 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:48.637145    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-lwsfg" podStartSLOduration=262.450198721 podStartE2EDuration="4m23.637126831s" podCreationTimestamp="2026-05-28 07:59:25 +0000 UTC" firstStartedPulling="2026-05-28 08:03:46.640578125 +0000 UTC m=+286.392050744" lastFinishedPulling="2026-05-28 08:03:47.827506231 +0000 UTC m=+287.578978854" observedRunningTime="2026-05-28 08:03:48.636079846 +0000 UTC m=+288.387552488" watchObservedRunningTime="2026-05-28 08:03:48.637126831 +0000 UTC m=+288.388599473"
May 28 08:03:49.626875 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.626838    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cgnw6" event={"ID":"99d1ceba-aa14-4a10-a971-baac94d0e263","Type":"ContainerStarted","Data":"4ed5f2d342a3bb1f98edf5cb46e4781a7f320c83986c5c6e6bba72e4c4f3d3ab"}
May 28 08:03:49.626875 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.626878    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cgnw6" event={"ID":"99d1ceba-aa14-4a10-a971-baac94d0e263","Type":"ContainerStarted","Data":"990b0342393c6633fc428f743d5fbeb122fe8eb0477893c3b87c17d47b373377"}
May 28 08:03:49.627382 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.626981    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cgnw6"
May 28 08:03:49.628282 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.628256    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6vjq5" event={"ID":"7d051ba8-4737-4372-b17b-bbf9c9463a40","Type":"ContainerStarted","Data":"c1be6822cf5b80d46f8c0325d725fec6eb019a7965cf09b5906a04d01e13267b"}
May 28 08:03:49.644908 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.644860    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cgnw6" podStartSLOduration=251.433852561 podStartE2EDuration="4m13.644848172s" podCreationTimestamp="2026-05-28 07:59:36 +0000 UTC" firstStartedPulling="2026-05-28 08:03:46.547535678 +0000 UTC m=+286.299008296" lastFinishedPulling="2026-05-28 08:03:48.758531271 +0000 UTC m=+288.510003907" observedRunningTime="2026-05-28 08:03:49.643936829 +0000 UTC m=+289.395409471" watchObservedRunningTime="2026-05-28 08:03:49.644848172 +0000 UTC m=+289.396320813"
May 28 08:03:49.659052 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:49.659006    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6vjq5" podStartSLOduration=251.346751891 podStartE2EDuration="4m13.658994518s" podCreationTimestamp="2026-05-28 07:59:36 +0000 UTC" firstStartedPulling="2026-05-28 08:03:46.451702137 +0000 UTC m=+286.203174756" lastFinishedPulling="2026-05-28 08:03:48.763944751 +0000 UTC m=+288.515417383" observedRunningTime="2026-05-28 08:03:49.657745045 +0000 UTC m=+289.409217688" watchObservedRunningTime="2026-05-28 08:03:49.658994518 +0000 UTC m=+289.410467186"
May 28 08:03:59.632569 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:03:59.632539    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cgnw6"
May 28 08:04:00.726258 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:04:00.726223    2560 kubelet.go:1628] "Image garbage collection succeeded"
May 28 08:14:55.748155 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.748121    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:14:55.751104 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.751083    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.753456 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.753435    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 08:14:55.753593 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.753435    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 28 08:14:55.753826 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.753807    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 08:14:55.754755 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.754735    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-j6l7s\""
May 28 08:14:55.757793 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.757769    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:14:55.854570 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.854537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.854755 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.854589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9c2w\" (UniqueName: \"kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.956033 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.955998    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.956219 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.956062    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9c2w\" (UniqueName: \"kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.956480 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.956458    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:55.963892 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:55.963863    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9c2w\" (UniqueName: \"kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w\") pod \"postgres-7c7656cc6d-5m79g\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") " pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:56.061178 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:56.061098    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:14:56.180310 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:56.180280    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:14:56.183579 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:14:56.183554    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabdf6271_b106_41e0_96d1_71e96f0f006e.slice/crio-8c8a8fc99f8f1cb21e3ccac1d67a83d29a122b3d7e1042f2a3c385b9f07c8efa WatchSource:0}: Error finding container 8c8a8fc99f8f1cb21e3ccac1d67a83d29a122b3d7e1042f2a3c385b9f07c8efa: Status 404 returned error can't find the container with id 8c8a8fc99f8f1cb21e3ccac1d67a83d29a122b3d7e1042f2a3c385b9f07c8efa
May 28 08:14:56.185163 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:56.185142    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 08:14:56.309447 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:14:56.309408    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" event={"ID":"abdf6271-b106-41e0-96d1-71e96f0f006e","Type":"ContainerStarted","Data":"8c8a8fc99f8f1cb21e3ccac1d67a83d29a122b3d7e1042f2a3c385b9f07c8efa"}
May 28 08:15:02.122978 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:02.122951    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 28 08:15:02.327153 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:02.327115    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" event={"ID":"abdf6271-b106-41e0-96d1-71e96f0f006e","Type":"ContainerStarted","Data":"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"}
May 28 08:15:02.357940 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:02.357889    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" podStartSLOduration=1.431500286 podStartE2EDuration="7.357872476s" podCreationTimestamp="2026-05-28 08:14:55 +0000 UTC" firstStartedPulling="2026-05-28 08:14:56.185271956 +0000 UTC m=+955.936744575" lastFinishedPulling="2026-05-28 08:15:02.111644144 +0000 UTC m=+961.863116765" observedRunningTime="2026-05-28 08:15:02.356960483 +0000 UTC m=+962.108433126" watchObservedRunningTime="2026-05-28 08:15:02.357872476 +0000 UTC m=+962.109345117"
May 28 08:15:31.182266 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.182225    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-xs578"]
May 28 08:15:31.185556 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.185537    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:31.188030 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.188005    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 08:15:31.188148 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.188014    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-qlnc5\""
May 28 08:15:31.193027 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.192999    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-xs578"]
May 28 08:15:31.321651 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.321607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vdv\" (UniqueName: \"kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv\") pod \"feast-test-apply-xs578\" (UID: \"865f6a92-48d0-456b-b47e-e5c9b9734c27\") " pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:31.422116 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.422074    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vdv\" (UniqueName: \"kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv\") pod \"feast-test-apply-xs578\" (UID: \"865f6a92-48d0-456b-b47e-e5c9b9734c27\") " pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:31.429614 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.429590    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vdv\" (UniqueName: \"kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv\") pod \"feast-test-apply-xs578\" (UID: \"865f6a92-48d0-456b-b47e-e5c9b9734c27\") " pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:31.494512 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.494405    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:31.615158 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:31.615127    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-xs578"]
May 28 08:15:31.618621 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:15:31.618588    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod865f6a92_48d0_456b_b47e_e5c9b9734c27.slice/crio-3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6 WatchSource:0}: Error finding container 3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6: Status 404 returned error can't find the container with id 3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6
May 28 08:15:32.408016 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:32.407961    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerStarted","Data":"3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6"}
May 28 08:15:38.425471 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:38.425430    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerStarted","Data":"2fea26669289b64fffd816f8b95feeeac35a3c059e47e4a20cc811422f8b099d"}
May 28 08:15:44.448877 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:44.448838    2560 generic.go:358] "Generic (PLEG): container finished" podID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerID="2fea26669289b64fffd816f8b95feeeac35a3c059e47e4a20cc811422f8b099d" exitCode=0
May 28 08:15:44.449308 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:44.448910    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerDied","Data":"2fea26669289b64fffd816f8b95feeeac35a3c059e47e4a20cc811422f8b099d"}
May 28 08:15:45.452500 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:45.452464    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerStarted","Data":"4c07be64e1b286952a4aeb2043cea4fcc071a55fc1e5d9318de337405d977375"}
May 28 08:15:45.468044 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:45.467988    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-xs578" podStartSLOduration=8.578898777 podStartE2EDuration="14.467975435s" podCreationTimestamp="2026-05-28 08:15:31 +0000 UTC" firstStartedPulling="2026-05-28 08:15:31.620289485 +0000 UTC m=+991.371762104" lastFinishedPulling="2026-05-28 08:15:37.509366141 +0000 UTC m=+997.260838762" observedRunningTime="2026-05-28 08:15:45.466586514 +0000 UTC m=+1005.218059156" watchObservedRunningTime="2026-05-28 08:15:45.467975435 +0000 UTC m=+1005.219448076"
May 28 08:15:54.476062 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:54.476026    2560 generic.go:358] "Generic (PLEG): container finished" podID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerID="4c07be64e1b286952a4aeb2043cea4fcc071a55fc1e5d9318de337405d977375" exitCode=0
May 28 08:15:54.476526 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:54.476105    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerDied","Data":"4c07be64e1b286952a4aeb2043cea4fcc071a55fc1e5d9318de337405d977375"}
May 28 08:15:55.594353 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:55.594332    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:55.693411 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:55.693374    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8vdv\" (UniqueName: \"kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv\") pod \"865f6a92-48d0-456b-b47e-e5c9b9734c27\" (UID: \"865f6a92-48d0-456b-b47e-e5c9b9734c27\") "
May 28 08:15:55.695536 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:55.695500    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv" (OuterVolumeSpecName: "kube-api-access-x8vdv") pod "865f6a92-48d0-456b-b47e-e5c9b9734c27" (UID: "865f6a92-48d0-456b-b47e-e5c9b9734c27"). InnerVolumeSpecName "kube-api-access-x8vdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:15:55.794228 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:55.794144    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8vdv\" (UniqueName: \"kubernetes.io/projected/865f6a92-48d0-456b-b47e-e5c9b9734c27-kube-api-access-x8vdv\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:15:56.482182 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:56.482147    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xs578" event={"ID":"865f6a92-48d0-456b-b47e-e5c9b9734c27","Type":"ContainerDied","Data":"3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6"}
May 28 08:15:56.482182 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:56.482181    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2e54ff71df7f11ea231a65eddf9331918ba0aff8c512a09c89e7719d28e8e6"
May 28 08:15:56.482378 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:56.482192    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xs578"
May 28 08:15:56.650642 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:56.650610    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-xs578_865f6a92-48d0-456b-b47e-e5c9b9734c27/feast-0/0.log"
May 28 08:15:56.656077 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:15:56.656047    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-xs578_865f6a92-48d0-456b-b47e-e5c9b9734c27/feast-1/0.log"
May 28 08:16:31.779592 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:31.779558    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-xs578"]
May 28 08:16:31.784797 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:31.784773    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-xs578"]
May 28 08:16:31.792094 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:31.792074    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:16:31.792293 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:31.792253    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" podUID="abdf6271-b106-41e0-96d1-71e96f0f006e" containerName="postgres" containerID="cri-o://98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d" gracePeriod=30
May 28 08:16:32.027312 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.027289    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:16:32.142305 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.142279    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9c2w\" (UniqueName: \"kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w\") pod \"abdf6271-b106-41e0-96d1-71e96f0f006e\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") "
May 28 08:16:32.142445 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.142333    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata\") pod \"abdf6271-b106-41e0-96d1-71e96f0f006e\" (UID: \"abdf6271-b106-41e0-96d1-71e96f0f006e\") "
May 28 08:16:32.144417 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.144391    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w" (OuterVolumeSpecName: "kube-api-access-d9c2w") pod "abdf6271-b106-41e0-96d1-71e96f0f006e" (UID: "abdf6271-b106-41e0-96d1-71e96f0f006e"). InnerVolumeSpecName "kube-api-access-d9c2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:16:32.175247 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.175205    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "abdf6271-b106-41e0-96d1-71e96f0f006e" (UID: "abdf6271-b106-41e0-96d1-71e96f0f006e"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 08:16:32.243051 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.243003    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9c2w\" (UniqueName: \"kubernetes.io/projected/abdf6271-b106-41e0-96d1-71e96f0f006e-kube-api-access-d9c2w\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:16:32.243051 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.243048    2560 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/abdf6271-b106-41e0-96d1-71e96f0f006e-postgresdata\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:16:32.572721 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.572613    2560 generic.go:358] "Generic (PLEG): container finished" podID="abdf6271-b106-41e0-96d1-71e96f0f006e" containerID="98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d" exitCode=0
May 28 08:16:32.572721 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.572688    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-5m79g"
May 28 08:16:32.572721 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.572698    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" event={"ID":"abdf6271-b106-41e0-96d1-71e96f0f006e","Type":"ContainerDied","Data":"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"}
May 28 08:16:32.572976 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.572739    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-5m79g" event={"ID":"abdf6271-b106-41e0-96d1-71e96f0f006e","Type":"ContainerDied","Data":"8c8a8fc99f8f1cb21e3ccac1d67a83d29a122b3d7e1042f2a3c385b9f07c8efa"}
May 28 08:16:32.572976 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.572767    2560 scope.go:117] "RemoveContainer" containerID="98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"
May 28 08:16:32.581324 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.581306    2560 scope.go:117] "RemoveContainer" containerID="98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"
May 28 08:16:32.581605 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:16:32.581581    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d\": container with ID starting with 98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d not found: ID does not exist" containerID="98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"
May 28 08:16:32.581644 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.581614    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d"} err="failed to get container status \"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d\": rpc error: code = NotFound desc = could not find container \"98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d\": container with ID starting with 98d0b080ae994ba3d55b0bcd1252cc80796d6f91841f624864661bbbf5c7107d not found: ID does not exist"
May 28 08:16:32.593007 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.592976    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:16:32.596401 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.596378    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-5m79g"]
May 28 08:16:32.810707 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.810676    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" path="/var/lib/kubelet/pods/865f6a92-48d0-456b-b47e-e5c9b9734c27/volumes"
May 28 08:16:32.811110 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:16:32.811096    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abdf6271-b106-41e0-96d1-71e96f0f006e" path="/var/lib/kubelet/pods/abdf6271-b106-41e0-96d1-71e96f0f006e/volumes"
May 28 08:18:56.746105 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746063    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746313    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abdf6271-b106-41e0-96d1-71e96f0f006e" containerName="postgres"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746324    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="abdf6271-b106-41e0-96d1-71e96f0f006e" containerName="postgres"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746334    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerName="feast-0"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746339    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerName="feast-0"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746346    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerName="feast-1"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746352    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerName="feast-1"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746390    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="abdf6271-b106-41e0-96d1-71e96f0f006e" containerName="postgres"
May 28 08:18:56.746628 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.746399    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="865f6a92-48d0-456b-b47e-e5c9b9734c27" containerName="feast-1"
May 28 08:18:56.748983 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.748962    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:18:56.751760 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.751732    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 28 08:18:56.751760 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.751733    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 28 08:18:56.752999 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.752978    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-w84r6\""
May 28 08:18:56.762930 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.762908    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:18:56.840867 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.840830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr6bc\" (UniqueName: \"kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc\") pod \"redis-854544c579-nz2pk\" (UID: \"231a822e-5e2f-4b44-bd90-2c1e78e04d87\") " pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:18:56.941751 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.941714    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mr6bc\" (UniqueName: \"kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc\") pod \"redis-854544c579-nz2pk\" (UID: \"231a822e-5e2f-4b44-bd90-2c1e78e04d87\") " pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:18:56.949525 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:56.949495    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr6bc\" (UniqueName: \"kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc\") pod \"redis-854544c579-nz2pk\" (UID: \"231a822e-5e2f-4b44-bd90-2c1e78e04d87\") " pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:18:57.058568 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:57.058476    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:18:57.179416 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:57.179387    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:18:57.182641 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:18:57.182613    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod231a822e_5e2f_4b44_bd90_2c1e78e04d87.slice/crio-b6e927d322614f7d6992ad897f5cb750aadb2779eaa872a72c2e56efbcc58471 WatchSource:0}: Error finding container b6e927d322614f7d6992ad897f5cb750aadb2779eaa872a72c2e56efbcc58471: Status 404 returned error can't find the container with id b6e927d322614f7d6992ad897f5cb750aadb2779eaa872a72c2e56efbcc58471
May 28 08:18:57.952153 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:57.952118    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-nz2pk" event={"ID":"231a822e-5e2f-4b44-bd90-2c1e78e04d87","Type":"ContainerStarted","Data":"b6e927d322614f7d6992ad897f5cb750aadb2779eaa872a72c2e56efbcc58471"}
May 28 08:18:58.956038 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:58.956004    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-nz2pk" event={"ID":"231a822e-5e2f-4b44-bd90-2c1e78e04d87","Type":"ContainerStarted","Data":"f7b96cf391af187095228e075133a87a42652b1a34b553d70f981037133e98b6"}
May 28 08:18:58.969964 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:18:58.969917    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-nz2pk" podStartSLOduration=1.6640945980000001 podStartE2EDuration="2.969903001s" podCreationTimestamp="2026-05-28 08:18:56 +0000 UTC" firstStartedPulling="2026-05-28 08:18:57.18426436 +0000 UTC m=+1196.935736979" lastFinishedPulling="2026-05-28 08:18:58.49007276 +0000 UTC m=+1198.241545382" observedRunningTime="2026-05-28 08:18:58.968928999 +0000 UTC m=+1198.720401641" watchObservedRunningTime="2026-05-28 08:18:58.969903001 +0000 UTC m=+1198.721375641"
May 28 08:19:07.251337 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.251299    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:19:07.254356 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.254339    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.257089 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.257064    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 28 08:19:07.261536 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.261509    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:19:07.312379 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.312346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bbs9\" (UniqueName: \"kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.312547 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.312408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.413395 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.413355    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.413586 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.413413    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bbs9\" (UniqueName: \"kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.413810 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.413785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.421327 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.421306    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bbs9\" (UniqueName: \"kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9\") pod \"postgres-7c7656cc6d-78ktb\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.564736 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.564626    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:19:07.685642 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.685619    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:19:07.688260 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:19:07.688232    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0127545f_113d_406c_a041_275e6c231662.slice/crio-637b93696a7c6c48bece18a878a619b8796d96ddf6fa327a4fc8304009bf78d5 WatchSource:0}: Error finding container 637b93696a7c6c48bece18a878a619b8796d96ddf6fa327a4fc8304009bf78d5: Status 404 returned error can't find the container with id 637b93696a7c6c48bece18a878a619b8796d96ddf6fa327a4fc8304009bf78d5
May 28 08:19:07.983937 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.983902    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" event={"ID":"0127545f-113d-406c-a041-275e6c231662","Type":"ContainerStarted","Data":"175810b0fc7185d9f8965e9977ef03cb66015358e37e20af810cc9b04aba74a5"}
May 28 08:19:07.983937 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.983941    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" event={"ID":"0127545f-113d-406c-a041-275e6c231662","Type":"ContainerStarted","Data":"637b93696a7c6c48bece18a878a619b8796d96ddf6fa327a4fc8304009bf78d5"}
May 28 08:19:07.998185 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:19:07.998114    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" podStartSLOduration=0.998097889 podStartE2EDuration="998.097889ms" podCreationTimestamp="2026-05-28 08:19:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:19:07.997825369 +0000 UTC m=+1207.749298010" watchObservedRunningTime="2026-05-28 08:19:07.998097889 +0000 UTC m=+1207.749570530"
May 28 08:21:26.197913 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.197873    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:21:26.198439 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.198076    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" podUID="0127545f-113d-406c-a041-275e6c231662" containerName="postgres" containerID="cri-o://175810b0fc7185d9f8965e9977ef03cb66015358e37e20af810cc9b04aba74a5" gracePeriod=30
May 28 08:21:26.202836 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.202810    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:21:26.203110 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.203084    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-nz2pk" podUID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" containerName="redis" containerID="cri-o://f7b96cf391af187095228e075133a87a42652b1a34b553d70f981037133e98b6" gracePeriod=30
May 28 08:21:26.342933 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.342896    2560 generic.go:358] "Generic (PLEG): container finished" podID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" containerID="f7b96cf391af187095228e075133a87a42652b1a34b553d70f981037133e98b6" exitCode=0
May 28 08:21:26.343115 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.342968    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-nz2pk" event={"ID":"231a822e-5e2f-4b44-bd90-2c1e78e04d87","Type":"ContainerDied","Data":"f7b96cf391af187095228e075133a87a42652b1a34b553d70f981037133e98b6"}
May 28 08:21:26.344824 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.344739    2560 generic.go:358] "Generic (PLEG): container finished" podID="0127545f-113d-406c-a041-275e6c231662" containerID="175810b0fc7185d9f8965e9977ef03cb66015358e37e20af810cc9b04aba74a5" exitCode=0
May 28 08:21:26.344824 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.344810    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" event={"ID":"0127545f-113d-406c-a041-275e6c231662","Type":"ContainerDied","Data":"175810b0fc7185d9f8965e9977ef03cb66015358e37e20af810cc9b04aba74a5"}
May 28 08:21:26.457024 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.457004    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:21:26.459855 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.459838    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:21:26.620891 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.620844    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr6bc\" (UniqueName: \"kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc\") pod \"231a822e-5e2f-4b44-bd90-2c1e78e04d87\" (UID: \"231a822e-5e2f-4b44-bd90-2c1e78e04d87\") "
May 28 08:21:26.621074 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.620915    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata\") pod \"0127545f-113d-406c-a041-275e6c231662\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") "
May 28 08:21:26.621074 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.621046    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bbs9\" (UniqueName: \"kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9\") pod \"0127545f-113d-406c-a041-275e6c231662\" (UID: \"0127545f-113d-406c-a041-275e6c231662\") "
May 28 08:21:26.623069 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.623035    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9" (OuterVolumeSpecName: "kube-api-access-7bbs9") pod "0127545f-113d-406c-a041-275e6c231662" (UID: "0127545f-113d-406c-a041-275e6c231662"). InnerVolumeSpecName "kube-api-access-7bbs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:21:26.623069 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.623065    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc" (OuterVolumeSpecName: "kube-api-access-mr6bc") pod "231a822e-5e2f-4b44-bd90-2c1e78e04d87" (UID: "231a822e-5e2f-4b44-bd90-2c1e78e04d87"). InnerVolumeSpecName "kube-api-access-mr6bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:21:26.650671 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.650621    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "0127545f-113d-406c-a041-275e6c231662" (UID: "0127545f-113d-406c-a041-275e6c231662"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 08:21:26.722126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.722040    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr6bc\" (UniqueName: \"kubernetes.io/projected/231a822e-5e2f-4b44-bd90-2c1e78e04d87-kube-api-access-mr6bc\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:21:26.722126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.722080    2560 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/0127545f-113d-406c-a041-275e6c231662-postgresdata\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:21:26.722126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:26.722090    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bbs9\" (UniqueName: \"kubernetes.io/projected/0127545f-113d-406c-a041-275e6c231662-kube-api-access-7bbs9\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:21:27.348069 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.348032    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-nz2pk" event={"ID":"231a822e-5e2f-4b44-bd90-2c1e78e04d87","Type":"ContainerDied","Data":"b6e927d322614f7d6992ad897f5cb750aadb2779eaa872a72c2e56efbcc58471"}
May 28 08:21:27.348069 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.348053    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-nz2pk"
May 28 08:21:27.348069 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.348079    2560 scope.go:117] "RemoveContainer" containerID="f7b96cf391af187095228e075133a87a42652b1a34b553d70f981037133e98b6"
May 28 08:21:27.349305 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.349281    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb" event={"ID":"0127545f-113d-406c-a041-275e6c231662","Type":"ContainerDied","Data":"637b93696a7c6c48bece18a878a619b8796d96ddf6fa327a4fc8304009bf78d5"}
May 28 08:21:27.349375 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.349290    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-78ktb"
May 28 08:21:27.355386 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.355367    2560 scope.go:117] "RemoveContainer" containerID="175810b0fc7185d9f8965e9977ef03cb66015358e37e20af810cc9b04aba74a5"
May 28 08:21:27.365141 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.365119    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:21:27.367020 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.367001    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-78ktb"]
May 28 08:21:27.375874 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.375854    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:21:27.377698 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:27.377679    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-nz2pk"]
May 28 08:21:28.809942 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:28.809909    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0127545f-113d-406c-a041-275e6c231662" path="/var/lib/kubelet/pods/0127545f-113d-406c-a041-275e6c231662/volumes"
May 28 08:21:28.810322 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:28.810231    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" path="/var/lib/kubelet/pods/231a822e-5e2f-4b44-bd90-2c1e78e04d87/volumes"
May 28 08:21:43.651751 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.651716    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.651963    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0127545f-113d-406c-a041-275e6c231662" containerName="postgres"
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.651974    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0127545f-113d-406c-a041-275e6c231662" containerName="postgres"
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.651986    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" containerName="redis"
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.651991    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" containerName="redis"
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.652037    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="0127545f-113d-406c-a041-275e6c231662" containerName="postgres"
May 28 08:21:43.652126 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.652048    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="231a822e-5e2f-4b44-bd90-2c1e78e04d87" containerName="redis"
May 28 08:21:43.655025 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.655008    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:43.657821 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.657802    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g5xjx\""
May 28 08:21:43.658990 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.658971    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 08:21:43.659095 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.659002    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 08:21:43.663620 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.663596    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:21:43.741724 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.741681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf5jg\" (UniqueName: \"kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg\") pod \"feast-operator-controller-manager-cf99db75-vmqpb\" (UID: \"af902400-80dc-4c7f-b9f5-a35b76294a29\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:43.842908 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.842866    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf5jg\" (UniqueName: \"kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg\") pod \"feast-operator-controller-manager-cf99db75-vmqpb\" (UID: \"af902400-80dc-4c7f-b9f5-a35b76294a29\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:43.852128 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.852100    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf5jg\" (UniqueName: \"kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg\") pod \"feast-operator-controller-manager-cf99db75-vmqpb\" (UID: \"af902400-80dc-4c7f-b9f5-a35b76294a29\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:43.965195 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:43.965111    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:44.086902 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:44.086874    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:21:44.089315 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:21:44.089287    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf902400_80dc_4c7f_b9f5_a35b76294a29.slice/crio-91214fcfa154309be546e36c3117b4a883e99aa22fdeb641bc6dbb615c2ab961 WatchSource:0}: Error finding container 91214fcfa154309be546e36c3117b4a883e99aa22fdeb641bc6dbb615c2ab961: Status 404 returned error can't find the container with id 91214fcfa154309be546e36c3117b4a883e99aa22fdeb641bc6dbb615c2ab961
May 28 08:21:44.091028 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:44.091007    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 08:21:44.393700 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:44.393638    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" event={"ID":"af902400-80dc-4c7f-b9f5-a35b76294a29","Type":"ContainerStarted","Data":"91214fcfa154309be546e36c3117b4a883e99aa22fdeb641bc6dbb615c2ab961"}
May 28 08:21:47.405199 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:47.405165    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" event={"ID":"af902400-80dc-4c7f-b9f5-a35b76294a29","Type":"ContainerStarted","Data":"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"}
May 28 08:21:47.405560 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:47.405293    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:21:47.421798 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:47.421742    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" podStartSLOduration=1.431692338 podStartE2EDuration="4.421730126s" podCreationTimestamp="2026-05-28 08:21:43 +0000 UTC" firstStartedPulling="2026-05-28 08:21:44.09115918 +0000 UTC m=+1363.842631799" lastFinishedPulling="2026-05-28 08:21:47.081196958 +0000 UTC m=+1366.832669587" observedRunningTime="2026-05-28 08:21:47.420385933 +0000 UTC m=+1367.171858575" watchObservedRunningTime="2026-05-28 08:21:47.421730126 +0000 UTC m=+1367.173202792"
May 28 08:21:58.413092 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:21:58.413054    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:22:00.804487 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:22:00.804456    2560 scope.go:117] "RemoveContainer" containerID="4c07be64e1b286952a4aeb2043cea4fcc071a55fc1e5d9318de337405d977375"
May 28 08:22:00.811958 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:22:00.811938    2560 scope.go:117] "RemoveContainer" containerID="2fea26669289b64fffd816f8b95feeeac35a3c059e47e4a20cc811422f8b099d"
May 28 08:27:11.643874 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:11.643841    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:27:11.644359 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:11.644066    2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" podUID="af902400-80dc-4c7f-b9f5-a35b76294a29" containerName="manager" containerID="cri-o://644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d" gracePeriod=10
May 28 08:27:11.874606 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:11.874580    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:27:11.942158 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:11.942078    2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf5jg\" (UniqueName: \"kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg\") pod \"af902400-80dc-4c7f-b9f5-a35b76294a29\" (UID: \"af902400-80dc-4c7f-b9f5-a35b76294a29\") "
May 28 08:27:11.944176 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:11.944150    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg" (OuterVolumeSpecName: "kube-api-access-pf5jg") pod "af902400-80dc-4c7f-b9f5-a35b76294a29" (UID: "af902400-80dc-4c7f-b9f5-a35b76294a29"). InnerVolumeSpecName "kube-api-access-pf5jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 08:27:12.042879 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.042827    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf5jg\" (UniqueName: \"kubernetes.io/projected/af902400-80dc-4c7f-b9f5-a35b76294a29-kube-api-access-pf5jg\") on node \"ip-10-0-141-246.ec2.internal\" DevicePath \"\""
May 28 08:27:12.244068 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.243971    2560 generic.go:358] "Generic (PLEG): container finished" podID="af902400-80dc-4c7f-b9f5-a35b76294a29" containerID="644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d" exitCode=0
May 28 08:27:12.244068 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.244033    2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"
May 28 08:27:12.244259 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.244062    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" event={"ID":"af902400-80dc-4c7f-b9f5-a35b76294a29","Type":"ContainerDied","Data":"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"}
May 28 08:27:12.244259 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.244102    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb" event={"ID":"af902400-80dc-4c7f-b9f5-a35b76294a29","Type":"ContainerDied","Data":"91214fcfa154309be546e36c3117b4a883e99aa22fdeb641bc6dbb615c2ab961"}
May 28 08:27:12.244259 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.244121    2560 scope.go:117] "RemoveContainer" containerID="644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"
May 28 08:27:12.251493 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.251469    2560 scope.go:117] "RemoveContainer" containerID="644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"
May 28 08:27:12.251798 ip-10-0-141-246 kubenswrapper[2560]: E0528 08:27:12.251773    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d\": container with ID starting with 644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d not found: ID does not exist" containerID="644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"
May 28 08:27:12.251869 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.251807    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d"} err="failed to get container status \"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d\": rpc error: code = NotFound desc = could not find container \"644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d\": container with ID starting with 644f64bac68766dbfb3321019aeb8fea24da88cf85ee422f99d25bc1583aad6d not found: ID does not exist"
May 28 08:27:12.264068 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.264042    2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:27:12.266959 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.266938    2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-vmqpb"]
May 28 08:27:12.810963 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:12.810922    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af902400-80dc-4c7f-b9f5-a35b76294a29" path="/var/lib/kubelet/pods/af902400-80dc-4c7f-b9f5-a35b76294a29/volumes"
May 28 08:27:15.993486 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.993451    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"]
May 28 08:27:15.993879 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.993687    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af902400-80dc-4c7f-b9f5-a35b76294a29" containerName="manager"
May 28 08:27:15.993879 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.993698    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="af902400-80dc-4c7f-b9f5-a35b76294a29" containerName="manager"
May 28 08:27:15.993879 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.993746    2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="af902400-80dc-4c7f-b9f5-a35b76294a29" containerName="manager"
May 28 08:27:15.996041 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.996025    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:15.998713 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.998693    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 08:27:15.999931 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.999912    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 08:27:16.000061 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:15.999919    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g5xjx\""
May 28 08:27:16.005539 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.005518    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"]
May 28 08:27:16.074055 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.074018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxl6w\" (UniqueName: \"kubernetes.io/projected/850d0a0a-a053-419e-bcbc-853a30cac586-kube-api-access-dxl6w\") pod \"feast-operator-controller-manager-cf99db75-gzfql\" (UID: \"850d0a0a-a053-419e-bcbc-853a30cac586\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:16.174967 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.174927    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxl6w\" (UniqueName: \"kubernetes.io/projected/850d0a0a-a053-419e-bcbc-853a30cac586-kube-api-access-dxl6w\") pod \"feast-operator-controller-manager-cf99db75-gzfql\" (UID: \"850d0a0a-a053-419e-bcbc-853a30cac586\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:16.195568 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.195542    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxl6w\" (UniqueName: \"kubernetes.io/projected/850d0a0a-a053-419e-bcbc-853a30cac586-kube-api-access-dxl6w\") pod \"feast-operator-controller-manager-cf99db75-gzfql\" (UID: \"850d0a0a-a053-419e-bcbc-853a30cac586\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:16.306072 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.305988    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:16.429678 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.429502    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"]
May 28 08:27:16.432354 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:27:16.432325    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850d0a0a_a053_419e_bcbc_853a30cac586.slice/crio-aa73c61d4cf2f8612af18e6da2860e56d2a037d67e1d862fd9bb46442e4ff547 WatchSource:0}: Error finding container aa73c61d4cf2f8612af18e6da2860e56d2a037d67e1d862fd9bb46442e4ff547: Status 404 returned error can't find the container with id aa73c61d4cf2f8612af18e6da2860e56d2a037d67e1d862fd9bb46442e4ff547
May 28 08:27:16.434471 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:16.434453    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 08:27:17.257963 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:17.257933    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql" event={"ID":"850d0a0a-a053-419e-bcbc-853a30cac586","Type":"ContainerStarted","Data":"1ce9d56469138e8a32ed97d25e034d8184122d6da944f79ebf09450bbe2fe87d"}
May 28 08:27:17.257963 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:17.257967    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql" event={"ID":"850d0a0a-a053-419e-bcbc-853a30cac586","Type":"ContainerStarted","Data":"aa73c61d4cf2f8612af18e6da2860e56d2a037d67e1d862fd9bb46442e4ff547"}
May 28 08:27:17.258462 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:17.257991    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:27:17.276214 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:17.276161    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql" podStartSLOduration=2.276144756 podStartE2EDuration="2.276144756s" podCreationTimestamp="2026-05-28 08:27:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:27:17.274825101 +0000 UTC m=+1697.026297742" watchObservedRunningTime="2026-05-28 08:27:17.276144756 +0000 UTC m=+1697.027617396"
May 28 08:27:28.264187 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:27:28.264153    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-gzfql"
May 28 08:32:45.819957 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.819891    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9p4l/must-gather-kg6bs"]
May 28 08:32:45.822026 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.822009    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:45.824635 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.824608    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9p4l\"/\"openshift-service-ca.crt\""
May 28 08:32:45.825805 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.825788    2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9p4l\"/\"default-dockercfg-6mk6k\""
May 28 08:32:45.825920 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.825829    2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9p4l\"/\"kube-root-ca.crt\""
May 28 08:32:45.829222 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.828977    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/must-gather-kg6bs"]
May 28 08:32:45.982795 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.982756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzsf\" (UniqueName: \"kubernetes.io/projected/076c8a9b-2d30-436d-bbad-7e500d97f657-kube-api-access-mpzsf\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:45.982795 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:45.982806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/076c8a9b-2d30-436d-bbad-7e500d97f657-must-gather-output\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.083648 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.083579    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzsf\" (UniqueName: \"kubernetes.io/projected/076c8a9b-2d30-436d-bbad-7e500d97f657-kube-api-access-mpzsf\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.083648 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.083620    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/076c8a9b-2d30-436d-bbad-7e500d97f657-must-gather-output\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.083939 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.083923    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/076c8a9b-2d30-436d-bbad-7e500d97f657-must-gather-output\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.091852 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.091825    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzsf\" (UniqueName: \"kubernetes.io/projected/076c8a9b-2d30-436d-bbad-7e500d97f657-kube-api-access-mpzsf\") pod \"must-gather-kg6bs\" (UID: \"076c8a9b-2d30-436d-bbad-7e500d97f657\") " pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.131510 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.131480    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/must-gather-kg6bs"
May 28 08:32:46.253552 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.253516    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/must-gather-kg6bs"]
May 28 08:32:46.257359 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:32:46.257331    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076c8a9b_2d30_436d_bbad_7e500d97f657.slice/crio-18287940c77d224decdc6cd944abe89a13440bc9730f3b4456c9f2cdbb69fe85 WatchSource:0}: Error finding container 18287940c77d224decdc6cd944abe89a13440bc9730f3b4456c9f2cdbb69fe85: Status 404 returned error can't find the container with id 18287940c77d224decdc6cd944abe89a13440bc9730f3b4456c9f2cdbb69fe85
May 28 08:32:46.259076 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:46.259061    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 08:32:47.102765 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:47.102724    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/must-gather-kg6bs" event={"ID":"076c8a9b-2d30-436d-bbad-7e500d97f657","Type":"ContainerStarted","Data":"18287940c77d224decdc6cd944abe89a13440bc9730f3b4456c9f2cdbb69fe85"}
May 28 08:32:48.106914 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.106874    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/must-gather-kg6bs" event={"ID":"076c8a9b-2d30-436d-bbad-7e500d97f657","Type":"ContainerStarted","Data":"129768dfdf166deca3caa200a37150abf7c5d10c5a9e8f0435e7a88233aaeec3"}
May 28 08:32:48.106914 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.106922    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/must-gather-kg6bs" event={"ID":"076c8a9b-2d30-436d-bbad-7e500d97f657","Type":"ContainerStarted","Data":"1c071d23f022b08fd2c946bc6a30b87601508fe89e8eb2f4baea22a07466a6d8"}
May 28 08:32:48.123847 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.123793    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-j9p4l/must-gather-kg6bs" podStartSLOduration=2.296419603 podStartE2EDuration="3.123776728s" podCreationTimestamp="2026-05-28 08:32:45 +0000 UTC" firstStartedPulling="2026-05-28 08:32:46.259184006 +0000 UTC m=+2026.010656625" lastFinishedPulling="2026-05-28 08:32:47.086541124 +0000 UTC m=+2026.838013750" observedRunningTime="2026-05-28 08:32:48.12274408 +0000 UTC m=+2027.874216725" watchObservedRunningTime="2026-05-28 08:32:48.123776728 +0000 UTC m=+2027.875249368"
May 28 08:32:48.370152 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.370117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rb6bw_7f675a40-07fe-4d17-b358-d0ff493f069a/global-pull-secret-syncer/0.log"
May 28 08:32:48.467298 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.467264    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ts8lq_e5371b78-e249-4770-9029-8d8b46048db6/konnectivity-agent/0.log"
May 28 08:32:48.526545 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:48.526513    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-246.ec2.internal_0fa0fdf0c2348838da79ae1cda82e96b/haproxy/0.log"
May 28 08:32:52.117156 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:52.117120    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwl54_b7c9c01e-725c-484a-970e-fcc1e697f5ed/node-exporter/0.log"
May 28 08:32:52.137338 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:52.137309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwl54_b7c9c01e-725c-484a-970e-fcc1e697f5ed/kube-rbac-proxy/0.log"
May 28 08:32:52.158758 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:52.158718    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwl54_b7c9c01e-725c-484a-970e-fcc1e697f5ed/init-textfile/0.log"
May 28 08:32:53.841517 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:53.841460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-lwsfg_d54e4595-8b3f-4c16-8d56-38d8029a3cff/networking-console-plugin/0.log"
May 28 08:32:54.876380 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.876339    2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"]
May 28 08:32:54.879774 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.879743    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:54.897003 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.896974    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"]
May 28 08:32:54.958411 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.958379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-lib-modules\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:54.958602 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.958439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-sys\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:54.958602 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.958536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-podres\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:54.958602 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.958574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2cwj\" (UniqueName: \"kubernetes.io/projected/db466025-5737-45dc-80c7-29b7d31ca654-kube-api-access-k2cwj\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:54.958788 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:54.958695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-proc\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.059837 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.059804    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-sys\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060021 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.059848    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-podres\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060021 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.059937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-sys\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060021 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.059960    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-podres\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060021 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.059962    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2cwj\" (UniqueName: \"kubernetes.io/projected/db466025-5737-45dc-80c7-29b7d31ca654-kube-api-access-k2cwj\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060199 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.060021    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-proc\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060199 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.060051    2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-lib-modules\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060199 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.060088    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-proc\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.060199 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.060161    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db466025-5737-45dc-80c7-29b7d31ca654-lib-modules\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.067920 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.067893    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2cwj\" (UniqueName: \"kubernetes.io/projected/db466025-5737-45dc-80c7-29b7d31ca654-kube-api-access-k2cwj\") pod \"perf-node-gather-daemonset-b6dkj\" (UID: \"db466025-5737-45dc-80c7-29b7d31ca654\") " pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.191050 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.190971    2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:55.343853 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.343824    2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"]
May 28 08:32:55.347388 ip-10-0-141-246 kubenswrapper[2560]: W0528 08:32:55.346777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb466025_5737_45dc_80c7_29b7d31ca654.slice/crio-b564682fe3b7872b9987bad237b768d098b34c12b02ec41dd0b942cf23c95818 WatchSource:0}: Error finding container b564682fe3b7872b9987bad237b768d098b34c12b02ec41dd0b942cf23c95818: Status 404 returned error can't find the container with id b564682fe3b7872b9987bad237b768d098b34c12b02ec41dd0b942cf23c95818
May 28 08:32:55.629302 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.629254    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cgnw6_99d1ceba-aa14-4a10-a971-baac94d0e263/dns/0.log"
May 28 08:32:55.647036 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.647011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cgnw6_99d1ceba-aa14-4a10-a971-baac94d0e263/kube-rbac-proxy/0.log"
May 28 08:32:55.726418 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:55.726354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x6h8q_d17fd3ad-bad2-4446-8856-471dd95615a6/dns-node-resolver/0.log"
May 28 08:32:56.133463 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:56.133427    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj" event={"ID":"db466025-5737-45dc-80c7-29b7d31ca654","Type":"ContainerStarted","Data":"f544a3d7df4c3265f8186eb6b720a45051433f478e2539b8dc4470b0629bf93f"}
May 28 08:32:56.133863 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:56.133471    2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj" event={"ID":"db466025-5737-45dc-80c7-29b7d31ca654","Type":"ContainerStarted","Data":"b564682fe3b7872b9987bad237b768d098b34c12b02ec41dd0b942cf23c95818"}
May 28 08:32:56.133863 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:56.133554    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:32:56.149106 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:56.149066    2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj" podStartSLOduration=2.149054352 podStartE2EDuration="2.149054352s" podCreationTimestamp="2026-05-28 08:32:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 08:32:56.14783869 +0000 UTC m=+2035.899311355" watchObservedRunningTime="2026-05-28 08:32:56.149054352 +0000 UTC m=+2035.900526993"
May 28 08:32:56.172615 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:56.172587    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2zms_9eb1bba5-3eef-4610-a1d2-4ee55d20758c/node-ca/0.log"
May 28 08:32:57.061554 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:57.061518    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6vjq5_7d051ba8-4737-4372-b17b-bbf9c9463a40/serve-healthcheck-canary/0.log"
May 28 08:32:57.493390 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:57.493367    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st2m4_e2c71d45-8958-4c56-a884-1b15e7267586/kube-rbac-proxy/0.log"
May 28 08:32:57.511922 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:57.511898    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st2m4_e2c71d45-8958-4c56-a884-1b15e7267586/exporter/0.log"
May 28 08:32:57.534136 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:32:57.534107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-st2m4_e2c71d45-8958-4c56-a884-1b15e7267586/extractor/0.log"
May 28 08:33:02.147031 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.147003    2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9p4l/perf-node-gather-daemonset-b6dkj"
May 28 08:33:02.685011 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.684982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/kube-multus-additional-cni-plugins/0.log"
May 28 08:33:02.705468 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.705437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/egress-router-binary-copy/0.log"
May 28 08:33:02.724595 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.724572    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/cni-plugins/0.log"
May 28 08:33:02.745884 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.745857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/bond-cni-plugin/0.log"
May 28 08:33:02.764671 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.764631    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/routeoverride-cni/0.log"
May 28 08:33:02.782748 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.782723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/whereabouts-cni-bincopy/0.log"
May 28 08:33:02.800775 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:02.800747    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jxsjb_51ecdec3-1e94-4b4e-9889-fe093d29749f/whereabouts-cni/0.log"
May 28 08:33:03.031506 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:03.031424    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sh5nm_353ec337-7a4b-4f38-9bf6-b39f3aca7021/kube-multus/0.log"
May 28 08:33:03.107955 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:03.107931    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rw9j6_24788ad9-6968-4ee0-91be-fbb624852ddf/network-metrics-daemon/0.log"
May 28 08:33:03.135490 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:03.135458    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rw9j6_24788ad9-6968-4ee0-91be-fbb624852ddf/kube-rbac-proxy/0.log"
May 28 08:33:04.261819 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.261792    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/ovn-controller/0.log"
May 28 08:33:04.292067 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.292020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/ovn-acl-logging/0.log"
May 28 08:33:04.311255 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.311221    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/kube-rbac-proxy-node/0.log"
May 28 08:33:04.334697 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.334669    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/kube-rbac-proxy-ovn-metrics/0.log"
May 28 08:33:04.351419 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.351401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/northd/0.log"
May 28 08:33:04.373513 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.373487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/nbdb/0.log"
May 28 08:33:04.392247 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.392222    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/sbdb/0.log"
May 28 08:33:04.494806 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:04.494736    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h96rd_010cd40a-b776-49aa-ae85-e932a37233b1/ovnkube-controller/0.log"
May 28 08:33:05.712207 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:05.712177    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-92x5x_b87584bb-c0bb-4c1c-b863-76b005ac3129/network-check-target-container/0.log"
May 28 08:33:06.540475 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:06.540433    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hm562_15f13d54-560a-4da9-bb9f-4e60707e902b/iptables-alerter/0.log"
May 28 08:33:07.152713 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:07.152688    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r4854_86e3227c-8954-49e1-9f64-f7d080c1b106/tuned/0.log"
May 28 08:33:10.123033 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:10.123000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kr6zh_e9279979-321e-45c8-9e80-033f7a537469/csi-driver/0.log"
May 28 08:33:10.141004 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:10.140975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kr6zh_e9279979-321e-45c8-9e80-033f7a537469/csi-node-driver-registrar/0.log"
May 28 08:33:10.160695 ip-10-0-141-246 kubenswrapper[2560]: I0528 08:33:10.160651    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kr6zh_e9279979-321e-45c8-9e80-033f7a537469/csi-liveness-probe/0.log"