May 21 16:34:12.048427 ip-10-0-143-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 16:34:12.048436 ip-10-0-143-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 16:34:12.048443 ip-10-0-143-162 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 16:34:12.048654 ip-10-0-143-162 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 16:34:22.178083 ip-10-0-143-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 16:34:22.178101 ip-10-0-143-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bb39f977ad5e429181770dfb1d8937b0 --
May 21 16:36:40.973205 ip-10-0-143-162 systemd[1]: Starting Kubernetes Kubelet...
May 21 16:36:41.434269 ip-10-0-143-162 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:36:41.434269 ip-10-0-143-162 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 16:36:41.434269 ip-10-0-143-162 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:36:41.434269 ip-10-0-143-162 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 16:36:41.434269 ip-10-0-143-162 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 16:36:41.438120 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.438033    2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 16:36:41.440679 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440663    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:36:41.440679 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440679    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440682    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440685    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440688    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440691    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440694    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440696    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440699    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440701    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440704    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440707    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440709    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440712    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440714    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440717    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440720    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440723    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440727    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440731    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440734    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:36:41.440740 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440737    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440740    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440742    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440745    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440748    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440750    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440753    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440757    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440760    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440762    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440765    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440767    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440770    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440773    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440775    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440778    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440780    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440783    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440785    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:36:41.441268 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440788    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440790    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440792    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440795    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440798    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440800    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440803    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440805    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440808    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440810    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440813    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440815    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440817    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440820    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440822    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440826    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440830    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440833    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440836    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440839    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:36:41.441725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440842    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440845    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440847    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440850    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440853    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440855    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440858    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440861    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440863    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440866    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440869    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440871    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440874    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440876    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440880    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440882    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440885    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440887    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440890    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:36:41.442261 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440892    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440895    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440897    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440900    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440902    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440905    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.440907    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441286    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441292    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441295    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441298    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441301    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441303    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441306    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441309    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441311    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441314    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441316    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441319    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441323    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:36:41.442723 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441326    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441328    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441331    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441333    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441336    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441339    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441343    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441345    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441348    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441350    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441353    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441355    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441358    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441360    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441362    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441365    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441367    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441370    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441373    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:36:41.443220 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441375    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441378    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441382    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441384    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441387    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441390    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441393    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441396    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441398    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441401    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441404    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441406    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441410    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441412    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441415    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441417    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441420    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441422    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441425    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441427    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:36:41.443695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441430    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441433    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441435    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441438    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441440    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441443    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441445    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441448    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441450    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441453    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441455    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441458    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441460    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441463    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441466    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441469    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441471    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441475    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441477    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441480    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:36:41.444198 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441483    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441485    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441487    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441490    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441492    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441495    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441497    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441500    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441502    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441505    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441507    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441510    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441514    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.441517    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442721    2559 flags.go:64] FLAG: --address="0.0.0.0"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442735    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442742    2559 flags.go:64] FLAG: --anonymous-auth="true"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442747    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442751    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442754    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442758    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 16:36:41.444725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442763    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442766    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442769    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442773    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442778    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442781    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442784    2559 flags.go:64] FLAG: --cgroup-root=""
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442787    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442790    2559 flags.go:64] FLAG: --client-ca-file=""
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442793    2559 flags.go:64] FLAG: --cloud-config=""
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442796    2559 flags.go:64] FLAG: --cloud-provider="external"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442799    2559 flags.go:64] FLAG: --cluster-dns="[]"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442803    2559 flags.go:64] FLAG: --cluster-domain=""
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442806    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442809    2559 flags.go:64] FLAG: --config-dir=""
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442812    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442815    2559 flags.go:64] FLAG: --container-log-max-files="5"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442819    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442822    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442825    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442829    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442832    2559 flags.go:64] FLAG: --contention-profiling="false"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442835    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442837    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442841    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 16:36:41.445263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442843    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442848    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442850    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442853    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442857    2559 flags.go:64] FLAG: --enable-load-reader="false"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442860    2559 flags.go:64] FLAG: --enable-server="true"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442863    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442867    2559 flags.go:64] FLAG: --event-burst="100"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442871    2559 flags.go:64] FLAG: --event-qps="50"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442874    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442877    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442880    2559 flags.go:64] FLAG: --eviction-hard=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442883    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442886    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442889    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442891    2559 flags.go:64] FLAG: --eviction-soft=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442894    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442897    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442900    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442902    2559 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442905    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442908    2559 flags.go:64] FLAG: --fail-swap-on="true"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442911    2559 flags.go:64] FLAG: --feature-gates=""
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442915    2559 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442918    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 16:36:41.445865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442921    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442924    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442928    2559 flags.go:64] FLAG: --healthz-port="10248"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442931    2559 flags.go:64] FLAG: --help="false"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442934    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-162.ec2.internal"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442950    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442954    2559 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442959    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442963    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442967    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442970    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442972    2559 flags.go:64] FLAG: --image-service-endpoint=""
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442975    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442978    2559 flags.go:64] FLAG: --kube-api-burst="100"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442981    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442984    2559 flags.go:64] FLAG: --kube-api-qps="50"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442987    2559 flags.go:64] FLAG: --kube-reserved=""
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442990    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442993    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442996    2559 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.442999    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443002    2559 flags.go:64] FLAG: --lock-file=""
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443005    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443008    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 16:36:41.446484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443010    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443016    2559 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443018    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443021    2559 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443024    2559 flags.go:64] FLAG: --logging-format="text"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443027    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443030    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443033    2559 flags.go:64] FLAG: --manifest-url=""
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443036    2559 flags.go:64] FLAG: --manifest-url-header=""
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443041    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443046    2559 flags.go:64] FLAG: --max-open-files="1000000"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443050    2559 flags.go:64] FLAG: --max-pods="110"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443053    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443056    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443059    2559 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443062    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443065    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443068    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443071    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443079    2559 flags.go:64] FLAG: --node-status-max-images="50"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443082    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443085    2559 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443087    2559 flags.go:64] FLAG: --pod-cidr=""
May 21 16:36:41.447077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443091    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443096    2559 flags.go:64] FLAG: --pod-manifest-path=""
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443099    2559 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443102    2559 flags.go:64] FLAG: --pods-per-core="0"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443105    2559 flags.go:64] FLAG: --port="10250"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443108    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443111    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-046a193ec0142ef24"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443114    2559 flags.go:64] FLAG: --qos-reserved=""
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443117    2559 flags.go:64] FLAG: --read-only-port="10255"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443121    2559 flags.go:64] FLAG: --register-node="true"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443124    2559 flags.go:64] FLAG: --register-schedulable="true"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443126    2559 flags.go:64] FLAG: --register-with-taints=""
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443130    2559 flags.go:64] FLAG: --registry-burst="10"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443133    2559 flags.go:64] FLAG: --registry-qps="5"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443136    2559 flags.go:64] FLAG: --reserved-cpus=""
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443138    2559 flags.go:64] FLAG: --reserved-memory=""
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443142    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443145    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443148    2559 flags.go:64] FLAG: --rotate-certificates="false"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443151    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443154    2559 flags.go:64] FLAG: --runonce="false"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443157    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443160    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443163    2559 flags.go:64] FLAG: --seccomp-default="false"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443166    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443169    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 16:36:41.447636 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443172    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443175    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443178    2559 flags.go:64] FLAG: --storage-driver-password="root"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443180    2559 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443184    2559 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443186    2559 flags.go:64] FLAG: --storage-driver-user="root"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443189    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443193    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443196    2559 flags.go:64] FLAG: --system-cgroups=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443199    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443205    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443208    2559 flags.go:64] FLAG: --tls-cert-file=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443211    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443215    2559 flags.go:64] FLAG: --tls-min-version=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443217    2559 flags.go:64] FLAG: --tls-private-key-file=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443220    2559 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443224    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443227    2559 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443230    2559 flags.go:64] FLAG: --v="2"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443235    2559 flags.go:64] FLAG: --version="false"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443239    2559 flags.go:64] FLAG: --vmodule=""
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443243    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.443246    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443336    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443340    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:36:41.448270 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443343    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443346    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443351    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443355    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443358    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443361    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443364    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443369    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443372    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443375    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443377    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443380    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443383    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443385    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443391    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443394    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443397    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443399    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443402    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:36:41.448872 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443405    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443407    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443410    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443412    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443415    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443418    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443420    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443423    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443425    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443428    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443431    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443433    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443436    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443438    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443441    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443443    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443446    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443449    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443451    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443454    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:36:41.449435 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443459    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443461    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443464    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443466    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443469    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443471    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443474    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443477    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443480    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443483    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443485    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443488    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443491    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443493    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443496    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443498    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443501    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443504    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443506    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443509    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:36:41.449933 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443511    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443514    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443516    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443519    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443521    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443524    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443527    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443529    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443532    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443535    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443538    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443540    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443544    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443546    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443549    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443551    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443554    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443558    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443560    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:36:41.450520 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443564    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443567    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443569    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443572    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443574    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.443577    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:36:41.451012 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.444439    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:36:41.451322 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.451303    2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 16:36:41.451354 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.451323    2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451369    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451374    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451378    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451381    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451385    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:36:41.451385 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451388    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451391    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451393    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451397    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451400    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451403    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451406    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451408    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451411    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451414    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451417    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451419    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451422    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451424    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451427    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451429    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451432    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451435    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451437    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451440    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:36:41.451538 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451443    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451445    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451448    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451451    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451454    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451456    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451460    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451463    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451466    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451468    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451471    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451474    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451476    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451480    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451486    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451489    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451492    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451495    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451497    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:36:41.452053 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451500    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451503    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451505    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451508    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451511    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451513    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451516    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451518    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451521    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451523    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451526    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451528    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451530    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451533    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451535    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451538    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451541    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451543    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451546    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451549    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:36:41.452599 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451552    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451555    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451557    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451560    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451562    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451565    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451568    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451571    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451574    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451577    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451579    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451582    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451586    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451589    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451592    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451595    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451597    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451600    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451602    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451605    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:36:41.453101 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451607    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451609    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.451615    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451738    2559 feature_gate.go:328] unrecognized feature gate: Example
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451743    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451746    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451749    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451753    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451757    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451760    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451764    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451767    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451769    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451773    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451776    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451779    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 16:36:41.453581 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451782    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451785    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451787    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451790    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451793    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451796    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451798    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451801    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451803    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451806    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451808    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451811    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451813    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451816    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451818    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451820    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451823    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451825    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451828    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451831    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 16:36:41.454051 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451833    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451835    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451838    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451840    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451843    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451845    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451847    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451850    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451853    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451856    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451860    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451862    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451865    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451867    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451870    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451873    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451875    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451878    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451880    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 16:36:41.454542 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451883    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451885    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451888    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451890    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451893    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451895    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451898    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451900    2559 feature_gate.go:328] unrecognized feature gate: Example2
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451903    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451905    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451908    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451910    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451913    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451915    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451917    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451920    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451922    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451925    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451927    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451930    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 16:36:41.455042 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451932    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451935    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451953    2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451955    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451959    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451961    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451964    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451967    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451970    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451972    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451975    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451977    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451980    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:41.451982    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.451987    2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 16:36:41.455519 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.452089    2559 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 16:36:41.455889 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.453960    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 16:36:41.455889 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.454900    2559 server.go:1019] "Starting client certificate rotation"
May 21 16:36:41.455889 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.454968    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:36:41.455889 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.455003    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 16:36:41.481875 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.481855    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:36:41.490235 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.490210    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 16:36:41.507952 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.507922    2559 log.go:25] "Validated CRI v1 runtime API"
May 21 16:36:41.513778 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.513763    2559 log.go:25] "Validated CRI v1 image API"
May 21 16:36:41.515246 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.515215    2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 16:36:41.515668 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.515653    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:36:41.519814 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.519795    2559 fs.go:135] Filesystem UUIDs: map[5f9b1ed4-bb44-44d1-84eb-24b32d4bfeb0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 824deb91-766d-4c8a-a1b3-a25095da25d2:/dev/nvme0n1p4]
May 21 16:36:41.519879 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.519813    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 16:36:41.524040 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.523922    2559 manager.go:217] Machine: {Timestamp:2026-05-21 16:36:41.523454438 +0000 UTC m=+0.430433387 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100497 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6cdaea3b68f2a146913a97b6c5ea SystemUUID:ec2a6cda-ea3b-68f2-a146-913a97b6c5ea BootID:bb39f977-ad5e-4291-8177-0dfb1d8937b0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:ff:f8:9f:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:ff:f8:9f:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:0d:71:98:0d:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 16:36:41.524979 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.524969    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 16:36:41.525061 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.525049    2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 16:36:41.527111 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.527091    2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 16:36:41.527246 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.527113    2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 16:36:41.527292 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.527256    2559 topology_manager.go:138] "Creating topology manager with none policy"
May 21 16:36:41.527292 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.527264    2559 container_manager_linux.go:306] "Creating device plugin manager"
May 21 16:36:41.527292 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.527271    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:36:41.528228 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.528217    2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 16:36:41.529370 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.529360    2559 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:36:41.529476 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.529467    2559 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 16:36:41.531974 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.531964    2559 kubelet.go:491] "Attempting to sync node with API server"
May 21 16:36:41.532008 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.531978    2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 16:36:41.532008 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.531990    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 16:36:41.532008 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.531999    2559 kubelet.go:397] "Adding apiserver pod source"
May 21 16:36:41.532008 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.532007    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 16:36:41.533140 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.533128    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:36:41.533197 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.533147    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 16:36:41.536531 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.536512    2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 16:36:41.541343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.541320    2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 16:36:41.542531 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542514    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542538    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542548    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542556    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542567    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542576    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542592    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542600    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542610    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 16:36:41.542629 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542618    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 16:36:41.542880 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.542641    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 16:36:41.543035 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.543024    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 16:36:41.544975 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.544964    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 16:36:41.545027 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.544979    2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 16:36:41.547061 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.547032    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 16:36:41.547436 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.547085    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 16:36:41.548182 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.548165    2559 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 16:36:41.548271 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.548208    2559 server.go:1295] "Started kubelet"
May 21 16:36:41.548344 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.548305    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 16:36:41.548497 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.548288    2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 16:36:41.548559 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.548517    2559 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 16:36:41.549143 ip-10-0-143-162 systemd[1]: Started Kubernetes Kubelet.
May 21 16:36:41.549683 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.549474    2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 16:36:41.551385 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.551366    2559 server.go:317] "Adding debug handlers to kubelet server"
May 21 16:36:41.555324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.555304    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 16:36:41.556072 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556053    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 16:36:41.556151 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556117    2559 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 16:36:41.556151 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556130    2559 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 16:36:41.556278 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556259    2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 16:36:41.556384 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556369    2559 reconstruct.go:97] "Volume reconstruction finished"
May 21 16:36:41.556384 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556384    2559 reconciler.go:26] "Reconciler: start to sync state"
May 21 16:36:41.556880 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556865    2559 factory.go:55] Registering systemd factory
May 21 16:36:41.557001 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.556954    2559 factory.go:223] Registration of the systemd container factory successfully
May 21 16:36:41.557105 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.557079    2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 16:36:41.557205 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557153    2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 16:36:41.557274 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557263    2559 factory.go:153] Registering CRI-O factory
May 21 16:36:41.557328 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557274    2559 factory.go:223] Registration of the crio container factory successfully
May 21 16:36:41.557328 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557326    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 16:36:41.557422 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557355    2559 factory.go:103] Registering Raw factory
May 21 16:36:41.557422 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557369    2559 manager.go:1196] Started watching for new ooms in manager
May 21 16:36:41.557508 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.557473    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.557867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.557853    2559 manager.go:319] Starting recovery of all containers
May 21 16:36:41.558181 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.557187    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-162.ec2.internal.18b1a1f507374692  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-162.ec2.internal,UID:ip-10-0-143-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-162.ec2.internal,},FirstTimestamp:2026-05-21 16:36:41.54817909 +0000 UTC m=+0.455158044,LastTimestamp:2026-05-21 16:36:41.54817909 +0000 UTC m=+0.455158044,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-162.ec2.internal,}"
May 21 16:36:41.561644 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.561616    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 16:36:41.561838 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.561810    2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 16:36:41.568845 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.568689    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xm6l6"
May 21 16:36:41.569687 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.569668    2559 manager.go:324] Recovery completed
May 21 16:36:41.574415 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.574403    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.576098 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576084    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.576185 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576115    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.576185 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576130    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.576412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576398    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xm6l6"
May 21 16:36:41.576640 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576627    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 16:36:41.576640 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576639    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 16:36:41.576706 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.576653    2559 state_mem.go:36] "Initialized new in-memory state store"
May 21 16:36:41.578332 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.578264    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-162.ec2.internal.18b1a1f508e14ced  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-162.ec2.internal,UID:ip-10-0-143-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-162.ec2.internal,},FirstTimestamp:2026-05-21 16:36:41.576099053 +0000 UTC m=+0.483078006,LastTimestamp:2026-05-21 16:36:41.576099053 +0000 UTC m=+0.483078006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-162.ec2.internal,}"
May 21 16:36:41.580257 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.580242    2559 policy_none.go:49] "None policy: Start"
May 21 16:36:41.580337 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.580262    2559 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 16:36:41.580337 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.580275    2559 state_mem.go:35] "Initializing new in-memory state store"
May 21 16:36:41.617490 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617472    2559 manager.go:341] "Starting Device Plugin manager"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.617500    2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617509    2559 server.go:85] "Starting device plugin registration server"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617763    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617775    2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617872    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617973    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.617983    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.618605    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 16:36:41.639267 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.618635    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.701016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.700966    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 16:36:41.702133 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.702120    2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 16:36:41.702188 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.702145    2559 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 16:36:41.702188 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.702161    2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 16:36:41.702188 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.702168    2559 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 16:36:41.702316 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.702199    2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 16:36:41.705246 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.705228    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:36:41.718054 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.718032    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.718787 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.718772    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.718864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.718805    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.718864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.718820    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.718864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.718861    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-162.ec2.internal"
May 21 16:36:41.727746 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.727725    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-162.ec2.internal"
May 21 16:36:41.727828 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.727747    2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-162.ec2.internal\": node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.743997 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.743975    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.803016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.802981    2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"]
May 21 16:36:41.803110 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.803052    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.803851 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.803835    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.803952 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.803867    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.803952 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.803881    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.806209 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806195    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.806370 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806354    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.806425 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806386    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.806884 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806862    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.806884 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806870    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.807058 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806895    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.807058 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806896    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.807058 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806919    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.807058 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.806906    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.809177 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.809164    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.809228 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.809190    2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 16:36:41.809759 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.809746    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientMemory"
May 21 16:36:41.809817 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.809771    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasNoDiskPressure"
May 21 16:36:41.809817 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.809781    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeHasSufficientPID"
May 21 16:36:41.832471 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.832451    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-162.ec2.internal\" not found" node="ip-10-0-143-162.ec2.internal"
May 21 16:36:41.835904 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.835889    2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-162.ec2.internal\" not found" node="ip-10-0-143-162.ec2.internal"
May 21 16:36:41.844737 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.844720    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.858037 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.858020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/614b87cc09b6d11250a98b5fd2eae5c6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-162.ec2.internal\" (UID: \"614b87cc09b6d11250a98b5fd2eae5c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.858131 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.858050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.858131 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.858076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.945640 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:41.945606    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:41.959007 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.958990    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/614b87cc09b6d11250a98b5fd2eae5c6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-162.ec2.internal\" (UID: \"614b87cc09b6d11250a98b5fd2eae5c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.959071 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.959017    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.959071 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.959035    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.959071 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.959036    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/614b87cc09b6d11250a98b5fd2eae5c6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-162.ec2.internal\" (UID: \"614b87cc09b6d11250a98b5fd2eae5c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.959071 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.959060    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:41.959198 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:41.959077    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9f0a45e8a9181864da25f2c99197dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal\" (UID: \"ef9f0a45e8a9181864da25f2c99197dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:42.046433 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.046396    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.134920 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.134876    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:42.138682 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.138662    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:42.147058 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.147037    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.247656 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.247616    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.348136 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.348107    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.448621 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.448596    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.454758 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.454743    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 16:36:42.454883 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.454868    2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 16:36:42.498961 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.498900    2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:36:42.549058 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.549039    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.556190 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.556174    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 16:36:42.565384 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.565366    2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 16:36:42.577971 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.577947    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 16:31:41 +0000 UTC" deadline="2028-01-13 18:47:17.681822177 +0000 UTC"
May 21 16:36:42.577971 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.577968    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14450h10m35.103856125s"
May 21 16:36:42.589828 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.589810    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkrmr"
May 21 16:36:42.601990 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.601966    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkrmr"
May 21 16:36:42.649698 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.649677    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.750517 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.750455    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.782124 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:42.782095    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9f0a45e8a9181864da25f2c99197dd.slice/crio-e40c5ee6d9fe361515d4ea113cc918282873facecaf7f72720358e68f2edff26 WatchSource:0}: Error finding container e40c5ee6d9fe361515d4ea113cc918282873facecaf7f72720358e68f2edff26: Status 404 returned error can't find the container with id e40c5ee6d9fe361515d4ea113cc918282873facecaf7f72720358e68f2edff26
May 21 16:36:42.782310 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:42.782290    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614b87cc09b6d11250a98b5fd2eae5c6.slice/crio-c5f0b88886c399dcd59b712a7dae64635c3ee0f9799895c065c835c0a13d179d WatchSource:0}: Error finding container c5f0b88886c399dcd59b712a7dae64635c3ee0f9799895c065c835c0a13d179d: Status 404 returned error can't find the container with id c5f0b88886c399dcd59b712a7dae64635c3ee0f9799895c065c835c0a13d179d
May 21 16:36:42.786030 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.786016    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:36:42.825052 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.825029    2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:36:42.850844 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.850823    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.951335 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:42.951304    2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-162.ec2.internal\" not found"
May 21 16:36:42.990646 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:42.990625    2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:36:43.057360 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.057301    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal"
May 21 16:36:43.072762 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.072744    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:36:43.073660 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.073649    2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal"
May 21 16:36:43.081687 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.081671    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 16:36:43.533464 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.533423    2559 apiserver.go:52] "Watching apiserver"
May 21 16:36:43.539505 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.539360    2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 16:36:43.541031 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.540996    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hxc5n","openshift-network-operator/iptables-alerter-tg5h9","openshift-ovn-kubernetes/ovnkube-node-5hnwh","kube-system/konnectivity-agent-dxgk6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-b9b9d","kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z7wwt","openshift-image-registry/node-ca-9v4xh","openshift-multus/multus-9td9l","openshift-multus/network-metrics-daemon-78bbj"]
May 21 16:36:43.543485 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.543463    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.545832 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.545597    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vrwtx\""
May 21 16:36:43.545975 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.545957    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 16:36:43.546031 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.545965    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 16:36:43.547095 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.546602    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.548627 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.548608    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 16:36:43.549242 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.549032    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 16:36:43.549242 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.549049    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 16:36:43.549242 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.549222    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 16:36:43.549432 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.549319    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zhhb\""
May 21 16:36:43.549432 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.549424    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 16:36:43.551286 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.551265    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.553009 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.552989    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 16:36:43.553371 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.553355    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 16:36:43.553514 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.553498    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9jrmt\""
May 21 16:36:43.553584 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.553543    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 16:36:43.553638 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.553627    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.553782 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.553766    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9td9l"
May 21 16:36:43.556157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.555823    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 16:36:43.556157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.555846    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 16:36:43.556157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.555994    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zpkk7\""
May 21 16:36:43.556157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.556066    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 16:36:43.556157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.556140    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xc8fp\""
May 21 16:36:43.558319 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.558300    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:43.558408 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.558384    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:43.558471 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.558404    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.560749 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.560607    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 16:36:43.560749 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.560607    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 16:36:43.560749 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.560647    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 16:36:43.560962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.560800    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q9rsc\""
May 21 16:36:43.563224 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.563144    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.563224 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.563200    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.565810 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.565614    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.565810 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.565671    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 16:36:43.565810 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.565679    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:43.566553 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.566269    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 16:36:43.566553 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.566523    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 16:36:43.566553 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.566532    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 16:36:43.566737 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.566638    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 16:36:43.566823 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.566802    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 16:36:43.567040 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567023    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 16:36:43.567125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567107    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 16:36:43.567261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567243    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 16:36:43.567261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/429870d1-37a9-4902-a7e6-9f907b0cf382-serviceca\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhn58\" (UniqueName: \"kubernetes.io/projected/c99c241b-a610-4932-885d-c36fcf4af460-kube-api-access-vhn58\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysconfig\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-kubernetes\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567380    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rmg6k\""
May 21 16:36:43.567409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-host\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0827bc5c-9235-4b8e-9977-1ff088123785-iptables-alerter-script\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-systemd\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-run\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-os-release\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-bin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-multus-certs\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5m9\" (UniqueName: \"kubernetes.io/projected/0827bc5c-9235-4b8e-9977-1ff088123785-kube-api-access-kz5m9\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/429870d1-37a9-4902-a7e6-9f907b0cf382-host\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567650    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dhbsh\""
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-cnibin\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.567692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-modprobe-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cnibin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cni-binary-copy\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-hostroot\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48630100-e2a0-41f6-96e3-667310381bcf-konnectivity-ca\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.567990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-sys\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-var-lib-kubelet\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-system-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pprt8\" (UniqueName: \"kubernetes.io/projected/429870d1-37a9-4902-a7e6-9f907b0cf382-kube-api-access-pprt8\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxd4z\" (UniqueName: \"kubernetes.io/projected/cda17bfa-9f8d-47a8-b232-e6615ea3c936-kube-api-access-rxd4z\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-conf-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-daemon-config\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-etc-kubernetes\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.568299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2j5\" (UniqueName: \"kubernetes.io/projected/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-kube-api-access-kd2j5\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0827bc5c-9235-4b8e-9977-1ff088123785-host-slash\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-tuned\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-tmp\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-socket-dir-parent\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-netns\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-os-release\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-k8s-cni-cncf-io\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568524    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-multus\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-kubelet\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-system-cni-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-conf\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-lib-modules\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.569089 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.568647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48630100-e2a0-41f6-96e3-667310381bcf-agent-certs\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.604311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.604280    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:31:42 +0000 UTC" deadline="2027-11-19 10:59:39.024843259 +0000 UTC"
May 21 16:36:43.604311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.604311    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13122h22m55.420534695s"
May 21 16:36:43.657824 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.657768    2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 16:36:43.669628 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669594    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5m9\" (UniqueName: \"kubernetes.io/projected/0827bc5c-9235-4b8e-9977-1ff088123785-kube-api-access-kz5m9\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.669758 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669641    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/429870d1-37a9-4902-a7e6-9f907b0cf382-host\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.669758 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669672    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-cnibin\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.669758 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669700    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669751    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cni-binary-copy\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-cnibin\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669788    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-conf-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669815    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2j5\" (UniqueName: \"kubernetes.io/projected/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-kube-api-access-kd2j5\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/429870d1-37a9-4902-a7e6-9f907b0cf382-host\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669875    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48630100-e2a0-41f6-96e3-667310381bcf-konnectivity-ca\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-conf-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669900    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.669932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669929    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-kubelet\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.669995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-node-log\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-script-lib\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670116    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxd4z\" (UniqueName: \"kubernetes.io/projected/cda17bfa-9f8d-47a8-b232-e6615ea3c936-kube-api-access-rxd4z\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-netns\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-device-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670209    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0827bc5c-9235-4b8e-9977-1ff088123785-host-slash\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670235    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670281    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-socket-dir-parent\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670306    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-netns\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670306    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670349    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-multus\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-log-socket\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670411 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670391    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cni-binary-copy\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-netd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670430    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670471    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48630100-e2a0-41f6-96e3-667310381bcf-konnectivity-ca\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670500    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-netns\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670508    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-multus\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670517    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-conf\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670525    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670555    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-socket-dir-parent\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-config\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670572    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0827bc5c-9235-4b8e-9977-1ff088123785-host-slash\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670652    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-conf\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670655    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48630100-e2a0-41f6-96e3-667310381bcf-agent-certs\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670691    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670709    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-host\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.670948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-systemd-units\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670773    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-systemd\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670788    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-run\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-os-release\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670858    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-multus-certs\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670863    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-systemd\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670874    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670911    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-run\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662wf\" (UniqueName: \"kubernetes.io/projected/bf3aa270-6245-4d85-80c4-d7a428ae658b-kube-api-access-662wf\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670954    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-host\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670972    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-multus-certs\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670969    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.670980    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-os-release\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671018    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-modprobe-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671041    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c99c241b-a610-4932-885d-c36fcf4af460-cni-binary-copy\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671051    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cnibin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.671681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671076    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-hostroot\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671094    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-daemon-config\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-var-lib-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671137    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-hostroot\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671147    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-cnibin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-etc-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-modprobe-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-bin\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671249    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671274    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-sys\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671299    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-var-lib-kubelet\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671319    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-system-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-ovn\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671379    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-var-lib-kubelet\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671426    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-sys\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.672450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671439    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pprt8\" (UniqueName: \"kubernetes.io/projected/429870d1-37a9-4902-a7e6-9f907b0cf382-kube-api-access-pprt8\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671464    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-etc-kubernetes\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671478    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-system-cni-dir\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-systemd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671554    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-multus-daemon-config\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/3f468f62-9e3b-4fd8-a375-b63c33841d9d-kube-api-access-mgmbk\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671703    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-etc-kubernetes\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671786    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671810    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-tuned\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671827    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-tmp\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671871    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-kubelet\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjxtq\" (UniqueName: \"kubernetes.io/projected/62dede7c-6f25-4b01-bb91-dfa60b026466-kube-api-access-kjxtq\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671918    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-os-release\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671950    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-k8s-cni-cncf-io\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671970    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-system-cni-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.671984    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-lib-modules\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.673312 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-slash\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-lib-modules\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672151    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/429870d1-37a9-4902-a7e6-9f907b0cf382-serviceca\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672170    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhn58\" (UniqueName: \"kubernetes.io/projected/c99c241b-a610-4932-885d-c36fcf4af460-kube-api-access-vhn58\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672191    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysconfig\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-kubelet\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672203    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysctl-d\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672203    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-run-k8s-cni-cncf-io\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672222    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-kubernetes\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672269    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-os-release\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672287    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-bin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672303    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-sysconfig\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c99c241b-a610-4932-885d-c36fcf4af460-system-cni-dir\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-env-overrides\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672352    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-kubernetes\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672379    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-host-var-lib-cni-bin\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672418    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0827bc5c-9235-4b8e-9977-1ff088123785-iptables-alerter-script\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.674125 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672603    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/429870d1-37a9-4902-a7e6-9f907b0cf382-serviceca\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.674888 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.672949    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0827bc5c-9235-4b8e-9977-1ff088123785-iptables-alerter-script\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.675257 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.675192    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-tmp\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.675413 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.675395    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48630100-e2a0-41f6-96e3-667310381bcf-agent-certs\") pod \"konnectivity-agent-dxgk6\" (UID: \"48630100-e2a0-41f6-96e3-667310381bcf\") " pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.676332 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.676309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda17bfa-9f8d-47a8-b232-e6615ea3c936-etc-tuned\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.688714 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.688485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5m9\" (UniqueName: \"kubernetes.io/projected/0827bc5c-9235-4b8e-9977-1ff088123785-kube-api-access-kz5m9\") pod \"iptables-alerter-tg5h9\" (UID: \"0827bc5c-9235-4b8e-9977-1ff088123785\") " pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.692462 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.692430    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:43.692462 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.692454    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:43.692462 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.692466    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:43.692663 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.692568    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:44.192547356 +0000 UTC m=+3.099526305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:43.693091 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.693069    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pprt8\" (UniqueName: \"kubernetes.io/projected/429870d1-37a9-4902-a7e6-9f907b0cf382-kube-api-access-pprt8\") pod \"node-ca-9v4xh\" (UID: \"429870d1-37a9-4902-a7e6-9f907b0cf382\") " pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.693532 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.693512    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2j5\" (UniqueName: \"kubernetes.io/projected/5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06-kube-api-access-kd2j5\") pod \"multus-9td9l\" (UID: \"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06\") " pod="openshift-multus/multus-9td9l"
May 21 16:36:43.694867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.694816    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxd4z\" (UniqueName: \"kubernetes.io/projected/cda17bfa-9f8d-47a8-b232-e6615ea3c936-kube-api-access-rxd4z\") pod \"tuned-z7wwt\" (UID: \"cda17bfa-9f8d-47a8-b232-e6615ea3c936\") " pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.695177 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.695155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhn58\" (UniqueName: \"kubernetes.io/projected/c99c241b-a610-4932-885d-c36fcf4af460-kube-api-access-vhn58\") pod \"multus-additional-cni-plugins-b9b9d\" (UID: \"c99c241b-a610-4932-885d-c36fcf4af460\") " pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.709564 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.709504    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal" event={"ID":"614b87cc09b6d11250a98b5fd2eae5c6","Type":"ContainerStarted","Data":"c5f0b88886c399dcd59b712a7dae64635c3ee0f9799895c065c835c0a13d179d"}
May 21 16:36:43.711139 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.711110    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal" event={"ID":"ef9f0a45e8a9181864da25f2c99197dd","Type":"ContainerStarted","Data":"e40c5ee6d9fe361515d4ea113cc918282873facecaf7f72720358e68f2edff26"}
May 21 16:36:43.718086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.718066    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q7qg5"]
May 21 16:36:43.722138 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.722115    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.722224 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.722191    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:43.772715 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772691    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772724    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-662wf\" (UniqueName: \"kubernetes.io/projected/bf3aa270-6245-4d85-80c4-d7a428ae658b-kube-api-access-662wf\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772752    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-var-lib-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772781    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-etc-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772806    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-bin\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772817    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.772864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772845    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-ovn\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772871    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772869    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-var-lib-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772887    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-etc-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772897    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-bin\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772959    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-systemd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772979    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-ovn\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.772988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/3f468f62-9e3b-4fd8-a375-b63c33841d9d-kube-api-access-mgmbk\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773021    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773044    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-systemd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773061    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjxtq\" (UniqueName: \"kubernetes.io/projected/62dede7c-6f25-4b01-bb91-dfa60b026466-kube-api-access-kjxtq\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773091    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-slash\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773122    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-env-overrides\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773163    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773166    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-slash\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-socket-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773022    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773201    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-kubelet\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773226    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-node-log\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-run-openvswitch\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773244    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-kubelet\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773268    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-script-lib\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773276    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-node-log\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773295    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773319    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773391    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-sys-fs\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.773419    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773426    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-netns\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773452    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-device-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-dbus\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-run-netns\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773528    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-log-socket\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773555    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-netd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.773872 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773556    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-device-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.773583    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:36:44.273565475 +0000 UTC m=+3.180544424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773601    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-log-socket\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773617    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773644    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-cni-netd\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773679    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-config\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773687    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-registration-dir\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773693    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-env-overrides\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773703    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773773    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-script-lib\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62dede7c-6f25-4b01-bb91-dfa60b026466-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773803    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-systemd-units\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773839    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773873    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-kubelet-config\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773896    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-systemd-units\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.774723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.773907    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f468f62-9e3b-4fd8-a375-b63c33841d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.775565 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.774196    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovnkube-config\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.775565 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.775403    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f468f62-9e3b-4fd8-a375-b63c33841d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.783458 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.783413    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmbk\" (UniqueName: \"kubernetes.io/projected/3f468f62-9e3b-4fd8-a375-b63c33841d9d-kube-api-access-mgmbk\") pod \"ovnkube-node-5hnwh\" (UID: \"3f468f62-9e3b-4fd8-a375-b63c33841d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.783975 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.783915    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjxtq\" (UniqueName: \"kubernetes.io/projected/62dede7c-6f25-4b01-bb91-dfa60b026466-kube-api-access-kjxtq\") pod \"aws-ebs-csi-driver-node-jhhvg\" (UID: \"62dede7c-6f25-4b01-bb91-dfa60b026466\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:43.784309 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.784291    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-662wf\" (UniqueName: \"kubernetes.io/projected/bf3aa270-6245-4d85-80c4-d7a428ae658b-kube-api-access-662wf\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:43.855190 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.855159    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:36:43.864184 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.864164    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b9b9d"
May 21 16:36:43.873183 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.873162    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9v4xh"
May 21 16:36:43.874869 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.874848    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-kubelet-config\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.874987 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.874960    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-dbus\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.875047 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.874983    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-kubelet-config\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.875047 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.874994    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.875145 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.875072    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:43.875145 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:43.875133    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:36:44.375113893 +0000 UTC m=+3.282092851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:43.875258 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.875154    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40589b6b-0b94-4d0d-93aa-f5c96a6455de-dbus\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:43.880010 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.879993    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7wwt"
May 21 16:36:43.886708 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.886683    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9td9l"
May 21 16:36:43.887608 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.887588    2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 16:36:43.894544 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.894526    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg5h9"
May 21 16:36:43.902117 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.902101    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:36:43.908663 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:43.908645    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg"
May 21 16:36:44.276855 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.276825    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:44.277035 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.276886    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:44.277035 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277002    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:44.277035 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277019    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:44.277035 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277037    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:44.277235 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277049    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:44.277235 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277069    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:36:45.277045429 +0000 UTC m=+4.184024365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:44.277235 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.277094    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:45.277078977 +0000 UTC m=+4.184057919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:44.377847 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.377818    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:44.378018 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.377925    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:44.378018 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.377993    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:36:45.377980213 +0000 UTC m=+4.284959154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:44.483512 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.483488    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0827bc5c_9235_4b8e_9977_1ff088123785.slice/crio-df88f50b030423db24aff8abcd496513a362b159f5763ff81f805e8123b7731c WatchSource:0}: Error finding container df88f50b030423db24aff8abcd496513a362b159f5763ff81f805e8123b7731c: Status 404 returned error can't find the container with id df88f50b030423db24aff8abcd496513a362b159f5763ff81f805e8123b7731c
May 21 16:36:44.485326 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.485289    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f468f62_9e3b_4fd8_a375_b63c33841d9d.slice/crio-931db1009e2d51622b2aa7d04048a5e1320b9444d739c199dd91248fd2be3064 WatchSource:0}: Error finding container 931db1009e2d51622b2aa7d04048a5e1320b9444d739c199dd91248fd2be3064: Status 404 returned error can't find the container with id 931db1009e2d51622b2aa7d04048a5e1320b9444d739c199dd91248fd2be3064
May 21 16:36:44.488810 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.488790    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429870d1_37a9_4902_a7e6_9f907b0cf382.slice/crio-2447a0fe7ce72bfbe3eddd5cd349bf8f54f675b44c404310b010578d1fdd1f73 WatchSource:0}: Error finding container 2447a0fe7ce72bfbe3eddd5cd349bf8f54f675b44c404310b010578d1fdd1f73: Status 404 returned error can't find the container with id 2447a0fe7ce72bfbe3eddd5cd349bf8f54f675b44c404310b010578d1fdd1f73
May 21 16:36:44.489847 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.489825    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda17bfa_9f8d_47a8_b232_e6615ea3c936.slice/crio-2c420478ce4d809a19e7222167adda6808677f90336e00f854fc9f06037e6ca0 WatchSource:0}: Error finding container 2c420478ce4d809a19e7222167adda6808677f90336e00f854fc9f06037e6ca0: Status 404 returned error can't find the container with id 2c420478ce4d809a19e7222167adda6808677f90336e00f854fc9f06037e6ca0
May 21 16:36:44.491195 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.491013    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dede7c_6f25_4b01_bb91_dfa60b026466.slice/crio-ea9470b9ee5b6be9ab6f7278a4643b37be6420a3216bdd158f94d49e9ef9a2a4 WatchSource:0}: Error finding container ea9470b9ee5b6be9ab6f7278a4643b37be6420a3216bdd158f94d49e9ef9a2a4: Status 404 returned error can't find the container with id ea9470b9ee5b6be9ab6f7278a4643b37be6420a3216bdd158f94d49e9ef9a2a4
May 21 16:36:44.491812 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.491785    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f67ad56_5c6c_4860_8d8b_5e8e51d2eb06.slice/crio-aaeddf75a6428c2adfe3a725eb4b7cf9dc8094d62494d127c3dc97ef98d137a4 WatchSource:0}: Error finding container aaeddf75a6428c2adfe3a725eb4b7cf9dc8094d62494d127c3dc97ef98d137a4: Status 404 returned error can't find the container with id aaeddf75a6428c2adfe3a725eb4b7cf9dc8094d62494d127c3dc97ef98d137a4
May 21 16:36:44.493973 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.493810    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48630100_e2a0_41f6_96e3_667310381bcf.slice/crio-856f8cd63f307625af97725a0d611f4b503b78cccb9850484c83d2831b81b801 WatchSource:0}: Error finding container 856f8cd63f307625af97725a0d611f4b503b78cccb9850484c83d2831b81b801: Status 404 returned error can't find the container with id 856f8cd63f307625af97725a0d611f4b503b78cccb9850484c83d2831b81b801
May 21 16:36:44.497448 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:36:44.497428    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99c241b_a610_4932_885d_c36fcf4af460.slice/crio-70c65a610fd791056041f650d39f304919ff060d151d13706d0e0abe90dcd46d WatchSource:0}: Error finding container 70c65a610fd791056041f650d39f304919ff060d151d13706d0e0abe90dcd46d: Status 404 returned error can't find the container with id 70c65a610fd791056041f650d39f304919ff060d151d13706d0e0abe90dcd46d
May 21 16:36:44.605074 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.604852    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 16:31:42 +0000 UTC" deadline="2027-12-01 05:57:51.563406649 +0000 UTC"
May 21 16:36:44.605074 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.605054    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13405h21m6.958358371s"
May 21 16:36:44.702618 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.702582    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:44.702745 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:44.702694    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:44.716593 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.716565    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"931db1009e2d51622b2aa7d04048a5e1320b9444d739c199dd91248fd2be3064"}
May 21 16:36:44.718092 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.718068    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal" event={"ID":"614b87cc09b6d11250a98b5fd2eae5c6","Type":"ContainerStarted","Data":"faa95f2ea47bb90732348d5bca879dbf77e136d56893724dcf3874419a439eab"}
May 21 16:36:44.719157 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.719133    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxgk6" event={"ID":"48630100-e2a0-41f6-96e3-667310381bcf","Type":"ContainerStarted","Data":"856f8cd63f307625af97725a0d611f4b503b78cccb9850484c83d2831b81b801"}
May 21 16:36:44.720283 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.720258    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7wwt" event={"ID":"cda17bfa-9f8d-47a8-b232-e6615ea3c936","Type":"ContainerStarted","Data":"2c420478ce4d809a19e7222167adda6808677f90336e00f854fc9f06037e6ca0"}
May 21 16:36:44.722346 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.722321    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9v4xh" event={"ID":"429870d1-37a9-4902-a7e6-9f907b0cf382","Type":"ContainerStarted","Data":"2447a0fe7ce72bfbe3eddd5cd349bf8f54f675b44c404310b010578d1fdd1f73"}
May 21 16:36:44.723833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.723807    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg5h9" event={"ID":"0827bc5c-9235-4b8e-9977-1ff088123785","Type":"ContainerStarted","Data":"df88f50b030423db24aff8abcd496513a362b159f5763ff81f805e8123b7731c"}
May 21 16:36:44.724774 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.724751    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerStarted","Data":"70c65a610fd791056041f650d39f304919ff060d151d13706d0e0abe90dcd46d"}
May 21 16:36:44.725553 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.725534    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9td9l" event={"ID":"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06","Type":"ContainerStarted","Data":"aaeddf75a6428c2adfe3a725eb4b7cf9dc8094d62494d127c3dc97ef98d137a4"}
May 21 16:36:44.726367 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:44.726350    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg" event={"ID":"62dede7c-6f25-4b01-bb91-dfa60b026466","Type":"ContainerStarted","Data":"ea9470b9ee5b6be9ab6f7278a4643b37be6420a3216bdd158f94d49e9ef9a2a4"}
May 21 16:36:45.284507 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.284470    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:45.284692 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.284545    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:45.284692 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.284674    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:45.284804 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.284734    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:36:47.28471595 +0000 UTC m=+6.191694890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:45.285168 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.285147    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:45.285276 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.285175    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:45.285276 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.285187    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:45.285276 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.285233    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:47.285216223 +0000 UTC m=+6.192195165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:45.385341 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.385302    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:45.385514 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.385436    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:45.385514 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.385497    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:36:47.385479934 +0000 UTC m=+6.292458886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:45.702617 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.702539    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:45.703102 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.702682    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:45.705436 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.705414    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:45.705553 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:45.705519    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:45.742433 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.742401    2559 generic.go:358] "Generic (PLEG): container finished" podID="ef9f0a45e8a9181864da25f2c99197dd" containerID="d6b2cebcd3295183fdaf3fb13e3a02ec155dd94b3a7e4d85a24b88a20b732508" exitCode=0
May 21 16:36:45.743042 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.742998    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal" event={"ID":"ef9f0a45e8a9181864da25f2c99197dd","Type":"ContainerDied","Data":"d6b2cebcd3295183fdaf3fb13e3a02ec155dd94b3a7e4d85a24b88a20b732508"}
May 21 16:36:45.759259 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:45.759212    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-162.ec2.internal" podStartSLOduration=2.759195822 podStartE2EDuration="2.759195822s" podCreationTimestamp="2026-05-21 16:36:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:36:44.730670521 +0000 UTC m=+3.637649479" watchObservedRunningTime="2026-05-21 16:36:45.759195822 +0000 UTC m=+4.666174779"
May 21 16:36:46.703012 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:46.702979    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:46.703485 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:46.703109    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:46.748271 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:46.748233    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal" event={"ID":"ef9f0a45e8a9181864da25f2c99197dd","Type":"ContainerStarted","Data":"dd6037af5f6286918ca1c6280bee5f663c0ffcb1b462ef0ff60b70d013572498"}
May 21 16:36:47.301918 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:47.301872    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:47.302106 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:47.301957    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:47.302106 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302090    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:47.302244 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302151    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:36:51.302132596 +0000 UTC m=+10.209111536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:47.302580 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302560    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:47.302580 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302584    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:47.302732 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302597    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:47.302732 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.302639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:51.302624957 +0000 UTC m=+10.209603910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:47.402426 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:47.402390    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:47.402625 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.402608    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:47.402689 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.402676    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:36:51.402658348 +0000 UTC m=+10.309637287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:47.706689 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:47.704660    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:47.706689 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:47.704670    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:47.706689 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.704818    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:47.706689 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:47.704989    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:48.559775 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.559716    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-162.ec2.internal" podStartSLOduration=5.559696842 podStartE2EDuration="5.559696842s" podCreationTimestamp="2026-05-21 16:36:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:36:46.762241251 +0000 UTC m=+5.669220209" watchObservedRunningTime="2026-05-21 16:36:48.559696842 +0000 UTC m=+7.466675800"
May 21 16:36:48.560750 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.560034    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mjk2q"]
May 21 16:36:48.563685 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.563038    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.566702 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.566677    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 16:36:48.567389 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.566982    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bgghj\""
May 21 16:36:48.567389 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.567209    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 16:36:48.612781 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.612588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc63d811-c624-43ca-932f-cbed4e185260-hosts-file\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.612781 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.612669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pplf6\" (UniqueName: \"kubernetes.io/projected/dc63d811-c624-43ca-932f-cbed4e185260-kube-api-access-pplf6\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.612781 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.612703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc63d811-c624-43ca-932f-cbed4e185260-tmp-dir\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.702344 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.702315    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:48.702500 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:48.702437    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:48.713321 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.713295    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pplf6\" (UniqueName: \"kubernetes.io/projected/dc63d811-c624-43ca-932f-cbed4e185260-kube-api-access-pplf6\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.713800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.713339    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc63d811-c624-43ca-932f-cbed4e185260-tmp-dir\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.713800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.713392    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc63d811-c624-43ca-932f-cbed4e185260-hosts-file\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.713800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.713514    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc63d811-c624-43ca-932f-cbed4e185260-hosts-file\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.713984 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.713813    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc63d811-c624-43ca-932f-cbed4e185260-tmp-dir\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.724875 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.724823    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pplf6\" (UniqueName: \"kubernetes.io/projected/dc63d811-c624-43ca-932f-cbed4e185260-kube-api-access-pplf6\") pod \"node-resolver-mjk2q\" (UID: \"dc63d811-c624-43ca-932f-cbed4e185260\") " pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:48.876495 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:48.876420    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjk2q"
May 21 16:36:49.702798 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:49.702768    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:49.702996 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:49.702906    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:49.702996 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:49.702961    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:49.703125 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:49.703071    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:50.703059 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:50.703023    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:50.703537 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:50.703149    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:51.334804 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:51.334765    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:51.335020 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:51.334849    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:51.335093 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335020    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:51.335093 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335038    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:51.335093 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335052    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:51.335232 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335110    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:36:59.335091104 +0000 UTC m=+18.242070043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:51.335583 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335563    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:51.335682 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.335618    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:36:59.335602428 +0000 UTC m=+18.242581370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:51.435986 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:51.435888    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:51.436172 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.436073    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:51.436172 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.436136    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:36:59.436117701 +0000 UTC m=+18.343096642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:51.703576 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:51.703498    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:51.704019 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.703675    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:51.704019 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:51.703722    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:51.704019 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:51.703815    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:52.702588 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:52.702556    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:52.702774 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:52.702686    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:53.705618 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:53.705588    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:53.706121 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:53.705588    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:53.706121 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:53.705684    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:53.706121 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:53.705771    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:54.702439 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:54.702409    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:54.702591 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:54.702505    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:55.702487 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:55.702455    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:55.703005 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:55.702504    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:55.703005 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:55.702593    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:55.703005 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:55.702726    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:56.702520 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:56.702479    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:56.703050 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:56.702610    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:57.703151 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:57.703120    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:57.703598 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:57.703128    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:57.703598 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:57.703253    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:36:57.703598 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:57.703384    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:58.702643 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:58.702610    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:58.702845 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:58.702726    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:36:59.400370 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:59.400338    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:59.400386    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400504    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400528    2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400544    2559 projected.go:194] Error preparing data for projected volume kube-api-access-zj6cf for pod openshift-network-diagnostics/network-check-target-hxc5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400561    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400605    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf podName:3175078a-63ab-443b-93c5-d0ff348b1ab8 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.400586202 +0000 UTC m=+34.307565144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zj6cf" (UniqueName: "kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf") pod "network-check-target-hxc5n" (UID: "3175078a-63ab-443b-93c5-d0ff348b1ab8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 16:36:59.400777 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.400623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.400614908 +0000 UTC m=+34.307593844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 16:36:59.501543 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:59.501509    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:59.501698 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.501630    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 16:36:59.501698 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.501694    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret podName:40589b6b-0b94-4d0d-93aa-f5c96a6455de nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.501676895 +0000 UTC m=+34.408655832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret") pod "global-pull-secret-syncer-q7qg5" (UID: "40589b6b-0b94-4d0d-93aa-f5c96a6455de") : object "kube-system"/"original-pull-secret" not registered
May 21 16:36:59.702782 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:59.702704    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:36:59.702950 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:36:59.702705    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:36:59.702950 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.702830    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:36:59.703074 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:36:59.702922    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:00.703027 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:00.702996    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:00.703454 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:00.703100    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:01.703559 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:01.703512    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:01.704029 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:01.703613    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:01.704029 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:01.703686    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:01.704029 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:01.703763    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:01.925612 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:01.925585    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc63d811_c624_43ca_932f_cbed4e185260.slice/crio-e70176f7a400d566d9b7ec0267cce6ce874023c3f067e7d9e9330f6d7d10b4d6 WatchSource:0}: Error finding container e70176f7a400d566d9b7ec0267cce6ce874023c3f067e7d9e9330f6d7d10b4d6: Status 404 returned error can't find the container with id e70176f7a400d566d9b7ec0267cce6ce874023c3f067e7d9e9330f6d7d10b4d6
May 21 16:37:02.703196 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.702836    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:02.703338 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:02.703287    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:02.774598 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.774562    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxgk6" event={"ID":"48630100-e2a0-41f6-96e3-667310381bcf","Type":"ContainerStarted","Data":"1669fb2946bad2d3cbcd7c153d807e706001b42f4dda22719b8589f60ed9d648"}
May 21 16:37:02.775864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.775844    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7wwt" event={"ID":"cda17bfa-9f8d-47a8-b232-e6615ea3c936","Type":"ContainerStarted","Data":"5ad32c38dc355e3f8f22f389bb65ed03ee7e4c7366a9f136448fb7eb18d4fd71"}
May 21 16:37:02.777003 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.776976    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9v4xh" event={"ID":"429870d1-37a9-4902-a7e6-9f907b0cf382","Type":"ContainerStarted","Data":"9e06d7dba524311f1140c7b4667cbe35cec15d4fb780c65592c6675c41c69280"}
May 21 16:37:02.778111 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.778079    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjk2q" event={"ID":"dc63d811-c624-43ca-932f-cbed4e185260","Type":"ContainerStarted","Data":"0f12e51738d0e2aad7b6c0d8cc9b49c885cdba0d0029023eab08d2afc4cf8ae5"}
May 21 16:37:02.778210 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.778120    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjk2q" event={"ID":"dc63d811-c624-43ca-932f-cbed4e185260","Type":"ContainerStarted","Data":"e70176f7a400d566d9b7ec0267cce6ce874023c3f067e7d9e9330f6d7d10b4d6"}
May 21 16:37:02.779397 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.779373    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="91885f10d31ffbc6993f267d288a94529961c0ebedb10d9f3ffd5cb0a9c8223d" exitCode=0
May 21 16:37:02.779481 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.779443    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"91885f10d31ffbc6993f267d288a94529961c0ebedb10d9f3ffd5cb0a9c8223d"}
May 21 16:37:02.780708 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.780655    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9td9l" event={"ID":"5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06","Type":"ContainerStarted","Data":"26eb673f405801372d0d4e07bf8850b8a38898bb9af1bc07b75dc477515ca54e"}
May 21 16:37:02.781763 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.781743    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg" event={"ID":"62dede7c-6f25-4b01-bb91-dfa60b026466","Type":"ContainerStarted","Data":"850058f9d4492e1d9845277aba9cecf24f50a3b87144063df452fd91ec31e23d"}
May 21 16:37:02.783985 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.783970    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:37:02.784276 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784257    2559 generic.go:358] "Generic (PLEG): container finished" podID="3f468f62-9e3b-4fd8-a375-b63c33841d9d" containerID="d1f29860f639511c7d2d29c69841be75ec781c15ebea34253266717fe252a1b0" exitCode=1
May 21 16:37:02.784329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784285    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"cac22986c8a35b7d6a012f70b4db8bfcc7ce7835e6818b77f75646c5ed8acac9"}
May 21 16:37:02.784329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784297    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"3c60c7fec41a8358f40f8676d1c577d9ac05ad6a462ce1a4be2543634ab1f6ab"}
May 21 16:37:02.784329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784305    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"8e1f841b4925e051fa7ac7bf4f4e967416d24ef8d0e53c2f2372630fbb0f7b0c"}
May 21 16:37:02.784329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784315    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"7ec6a13a644960df98b0fc8c33fb12e83edc992f7bfc536cd2b011de83096f00"}
May 21 16:37:02.784329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784323    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerDied","Data":"d1f29860f639511c7d2d29c69841be75ec781c15ebea34253266717fe252a1b0"}
May 21 16:37:02.784475 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.784332    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"4e1cae2f8647ac6c4b99da9c072881ed3d0cdf171d2bc0a0cf5604a960e331ac"}
May 21 16:37:02.790994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.790959    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dxgk6" podStartSLOduration=4.337814175 podStartE2EDuration="21.790930694s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.49711127 +0000 UTC m=+3.404090206" lastFinishedPulling="2026-05-21 16:37:01.950227776 +0000 UTC m=+20.857206725" observedRunningTime="2026-05-21 16:37:02.790907849 +0000 UTC m=+21.697886806" watchObservedRunningTime="2026-05-21 16:37:02.790930694 +0000 UTC m=+21.697909652"
May 21 16:37:02.805560 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.805528    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9v4xh" podStartSLOduration=8.155731517 podStartE2EDuration="21.80552002s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.490713984 +0000 UTC m=+3.397692921" lastFinishedPulling="2026-05-21 16:36:58.140502485 +0000 UTC m=+17.047481424" observedRunningTime="2026-05-21 16:37:02.805357672 +0000 UTC m=+21.712336641" watchObservedRunningTime="2026-05-21 16:37:02.80552002 +0000 UTC m=+21.712498978"
May 21 16:37:02.820506 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.820468    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjk2q" podStartSLOduration=14.820456231 podStartE2EDuration="14.820456231s" podCreationTimestamp="2026-05-21 16:36:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:37:02.820065772 +0000 UTC m=+21.727044729" watchObservedRunningTime="2026-05-21 16:37:02.820456231 +0000 UTC m=+21.727435193"
May 21 16:37:02.849415 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.849383    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z7wwt" podStartSLOduration=4.390877924 podStartE2EDuration="21.849374536s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.493162928 +0000 UTC m=+3.400141864" lastFinishedPulling="2026-05-21 16:37:01.951659535 +0000 UTC m=+20.858638476" observedRunningTime="2026-05-21 16:37:02.849280135 +0000 UTC m=+21.756259093" watchObservedRunningTime="2026-05-21 16:37:02.849374536 +0000 UTC m=+21.756353494"
May 21 16:37:02.863058 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:02.863024    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9td9l" podStartSLOduration=3.947802511 podStartE2EDuration="21.863014149s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.495198958 +0000 UTC m=+3.402177895" lastFinishedPulling="2026-05-21 16:37:02.410410597 +0000 UTC m=+21.317389533" observedRunningTime="2026-05-21 16:37:02.862337927 +0000 UTC m=+21.769316890" watchObservedRunningTime="2026-05-21 16:37:02.863014149 +0000 UTC m=+21.769993106"
May 21 16:37:03.364172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.364040    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 16:37:03.629837 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.629700    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T16:37:03.364168407Z","UUID":"c23f5751-c635-4319-80b3-dd59cc34e25b","Handler":null,"Name":"","Endpoint":""}
May 21 16:37:03.631234 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.631211    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 16:37:03.631372 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.631239    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 16:37:03.703306 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.703280    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:03.703483 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.703280    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:03.703483 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:03.703410    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:03.703483 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:03.703460    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:03.787471 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.787441    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg5h9" event={"ID":"0827bc5c-9235-4b8e-9977-1ff088123785","Type":"ContainerStarted","Data":"68c912fbd0980d7af1ddd9190fa81e9b4039b23ebf90b9b19a705384d8290193"}
May 21 16:37:03.789285 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.789258    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg" event={"ID":"62dede7c-6f25-4b01-bb91-dfa60b026466","Type":"ContainerStarted","Data":"8654a3628967b8dc99b5788ad58ec9da4141d46f8d96cc36a2ef86e7e0af5d42"}
May 21 16:37:03.799111 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:03.799074    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tg5h9" podStartSLOduration=4.333971803 podStartE2EDuration="21.799061253s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.485404724 +0000 UTC m=+3.392383661" lastFinishedPulling="2026-05-21 16:37:01.950494171 +0000 UTC m=+20.857473111" observedRunningTime="2026-05-21 16:37:03.798839095 +0000 UTC m=+22.705818052" watchObservedRunningTime="2026-05-21 16:37:03.799061253 +0000 UTC m=+22.706040211"
May 21 16:37:04.703138 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.703097    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:04.703305 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:04.703224    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:04.792569 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.792495    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg" event={"ID":"62dede7c-6f25-4b01-bb91-dfa60b026466","Type":"ContainerStarted","Data":"e66aa7afef82598c767ec8249623f072052d70bb569188b6c3829388c7cb769b"}
May 21 16:37:04.795090 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.795070    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:37:04.795446 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.795427    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"b3b7851b587e40c280e04255113b48cd9177a93dcea7cb7b9d40db23f6b6af68"}
May 21 16:37:04.924104 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.924068    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:37:04.924708 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.924689    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:37:04.936392 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:04.936344    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhhvg" podStartSLOduration=3.233891109 podStartE2EDuration="22.936333823s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.493709013 +0000 UTC m=+3.400687949" lastFinishedPulling="2026-05-21 16:37:04.196151715 +0000 UTC m=+23.103130663" observedRunningTime="2026-05-21 16:37:04.805625995 +0000 UTC m=+23.712604947" watchObservedRunningTime="2026-05-21 16:37:04.936333823 +0000 UTC m=+23.843312781"
May 21 16:37:05.702459 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:05.702429    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:05.702620 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:05.702429    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:05.702620 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:05.702552    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:05.702707 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:05.702627    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:05.796981 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:05.796955    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:37:05.797503 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:05.797239    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dxgk6"
May 21 16:37:06.703715 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.702862    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:06.703715 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:06.703181    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:06.802030 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.802001    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:37:06.802576 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.802403    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"1ac67f9c8694b92dec0b1421a1e1a5c4a4e4e0a4f8fd1b0b11f8d5b1186de47e"}
May 21 16:37:06.802697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.802671    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:06.802865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.802843    2559 scope.go:117] "RemoveContainer" containerID="d1f29860f639511c7d2d29c69841be75ec781c15ebea34253266717fe252a1b0"
May 21 16:37:06.820893 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:06.820872    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:07.702810 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.702784    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:07.702981 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.702844    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:07.702981 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:07.702932    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:07.703054 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:07.703015    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:07.808996 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.808894    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:37:07.810580 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.809853    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" event={"ID":"3f468f62-9e3b-4fd8-a375-b63c33841d9d","Type":"ContainerStarted","Data":"ceb4b5d3dc11aa12870d888ede3dc4f97dc888464d2e6814348aa5a10c7f1180"}
May 21 16:37:07.810580 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.810007    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:07.810580 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.810045    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:07.828351 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.828325    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:07.842884 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:07.842831    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh" podStartSLOduration=8.345371896 podStartE2EDuration="25.84281486s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.487391374 +0000 UTC m=+3.394370311" lastFinishedPulling="2026-05-21 16:37:01.984834325 +0000 UTC m=+20.891813275" observedRunningTime="2026-05-21 16:37:07.841488958 +0000 UTC m=+26.748467919" watchObservedRunningTime="2026-05-21 16:37:07.84281486 +0000 UTC m=+26.749793820"
May 21 16:37:08.566383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.566349    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7qg5"]
May 21 16:37:08.566543 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.566458    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:08.566592 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:08.566568    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:08.569335 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.569312    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxc5n"]
May 21 16:37:08.569446 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.569417    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:08.569531 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:08.569508    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:08.570121 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.570101    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-78bbj"]
May 21 16:37:08.570198 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:08.570185    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:08.570328 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:08.570308    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:10.702825 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:10.702789    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:10.703209 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:10.702827    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:10.703209 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:10.702856    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:10.703209 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:10.703028    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:10.703351 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:10.703203    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:10.703351 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:10.703307    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:12.702800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:12.702586    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:12.703257 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:12.702586    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:12.703257 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:12.702850    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxc5n" podUID="3175078a-63ab-443b-93c5-d0ff348b1ab8"
May 21 16:37:12.703257 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:12.702586    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:12.703257 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:12.702922    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7qg5" podUID="40589b6b-0b94-4d0d-93aa-f5c96a6455de"
May 21 16:37:12.703257 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:12.703020    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:37:13.821384 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.821350    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="69c10fb0cd5a43f196ee6906f905ab50529a6b4563dede0f3a9eb34743c5ff8f" exitCode=0
May 21 16:37:13.821832 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.821398    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"69c10fb0cd5a43f196ee6906f905ab50529a6b4563dede0f3a9eb34743c5ff8f"}
May 21 16:37:13.876036 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.876009    2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-162.ec2.internal" event="NodeReady"
May 21 16:37:13.876150 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.876118    2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 16:37:13.908459 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.908437    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"]
May 21 16:37:13.968713 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.968686    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6656c5fcf6-jl2gx"]
May 21 16:37:13.968859 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.968719    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:13.970791 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.970772    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 16:37:13.971075 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.971058    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 16:37:13.971119 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.971101    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5t46\""
May 21 16:37:13.981700 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.981681    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"]
May 21 16:37:13.981829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.981813    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:13.984200 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.984153    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 16:37:13.984349 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.984334    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 16:37:13.984413 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.984367    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 16:37:13.984413 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.984367    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v7vw5\""
May 21 16:37:13.995819 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:13.995800    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 16:37:14.003865 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.003847    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"]
May 21 16:37:14.003963 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.003933    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.006555 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.006533    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 16:37:14.006823 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.006806    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w9lcz\""
May 21 16:37:14.007012 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.006991    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 16:37:14.007075 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.007054    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 16:37:14.007124 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.007106    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 16:37:14.013188 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.013168    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"]
May 21 16:37:14.013342 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.013325    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.015339 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.015323    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 16:37:14.028466 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.028446    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"]
May 21 16:37:14.028466 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.028468    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mmlw9"]
May 21 16:37:14.028597 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.028581    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.030918 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.030902    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 16:37:14.031015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.031000    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 16:37:14.031094 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.031012    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 16:37:14.031094 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.031023    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 16:37:14.047133 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.047116    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dl7vd"]
May 21 16:37:14.047281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.047268    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.049557 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.049539    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rk5f9\""
May 21 16:37:14.049638 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.049591    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 16:37:14.049766 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.049751    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 16:37:14.063673 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063656    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"]
May 21 16:37:14.063756 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063682    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"]
May 21 16:37:14.063756 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063695    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6656c5fcf6-jl2gx"]
May 21 16:37:14.063756 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063708    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"]
May 21 16:37:14.063893 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063785    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.063893 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063804    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl7vd"]
May 21 16:37:14.063893 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.063851    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmlw9"]
May 21 16:37:14.065965 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.065947    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 16:37:14.066049 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.065983    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 16:37:14.066049 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.065994    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 16:37:14.066144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.065986    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2nz4g\""
May 21 16:37:14.111991 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.111967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.112062 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.111997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112062 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.112137 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14f107f3-dd5b-4973-9af6-1224c12264da-klusterlet-config\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.112137 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112192 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112192 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112192 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qch6t\" (UniqueName: \"kubernetes.io/projected/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-kube-api-access-qch6t\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.112273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnlst\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.112273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2ed90146-3693-4a19-9d4e-acfe96c829a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.112383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.112383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.112383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.112383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjs8\" (UniqueName: \"kubernetes.io/projected/2ed90146-3693-4a19-9d4e-acfe96c829a8-kube-api-access-cmjs8\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.112511 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2725j\" (UniqueName: \"kubernetes.io/projected/14f107f3-dd5b-4973-9af6-1224c12264da-kube-api-access-2725j\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.112511 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.112511 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f107f3-dd5b-4973-9af6-1224c12264da-tmp\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.112511 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.112476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.212849 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.212822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.212849 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.212849    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.213056 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.212871    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.213056 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.212887    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.213056 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.212913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.213056 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.213001    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:14.213056 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.213014    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.213064    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:14.713050904 +0000 UTC m=+33.620029844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213059    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213093    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14f107f3-dd5b-4973-9af6-1224c12264da-klusterlet-config\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213117    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213142    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213172    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2ed90146-3693-4a19-9d4e-acfe96c829a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213194    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-config-volume\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ppz\" (UniqueName: \"kubernetes.io/projected/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-kube-api-access-89ppz\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.213315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213286    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.213142    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.213429    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:14.713412695 +0000 UTC m=+33.620391631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213644    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213674    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213693    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2725j\" (UniqueName: \"kubernetes.io/projected/14f107f3-dd5b-4973-9af6-1224c12264da-kube-api-access-2725j\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79vbh\" (UniqueName: \"kubernetes.io/projected/2111f36b-3a34-4262-8653-27c5ba27dc8a-kube-api-access-79vbh\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213759    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f107f3-dd5b-4973-9af6-1224c12264da-tmp\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-tmp-dir\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.213833 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213817    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213843    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213870    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213898    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjs8\" (UniqueName: \"kubernetes.io/projected/2ed90146-3693-4a19-9d4e-acfe96c829a8-kube-api-access-cmjs8\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.213989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214020    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2ed90146-3693-4a19-9d4e-acfe96c829a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214035    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214063    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qch6t\" (UniqueName: \"kubernetes.io/projected/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-kube-api-access-qch6t\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214094    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214122    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnlst\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.214281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.214219    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f107f3-dd5b-4973-9af6-1224c12264da-tmp\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.215085 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.215062    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.215204 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.215061    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.218173 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.218343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218301    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.218410 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218359    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.218761 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218730    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-ca\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.218858 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218810    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ed90146-3693-4a19-9d4e-acfe96c829a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.218917 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218876    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.218917 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.218905    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/14f107f3-dd5b-4973-9af6-1224c12264da-klusterlet-config\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.219121 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.219102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.222440 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.222419    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.227142 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.227121    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnlst\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.232067 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.232046    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qch6t\" (UniqueName: \"kubernetes.io/projected/7af44d0a-6a6c-414a-ba26-f64fc0388e5c-kube-api-access-qch6t\") pod \"managed-serviceaccount-addon-agent-6ff554864b-2llhq\" (UID: \"7af44d0a-6a6c-414a-ba26-f64fc0388e5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.233261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.233181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2725j\" (UniqueName: \"kubernetes.io/projected/14f107f3-dd5b-4973-9af6-1224c12264da-kube-api-access-2725j\") pod \"klusterlet-addon-workmgr-68bb88f766-scb99\" (UID: \"14f107f3-dd5b-4973-9af6-1224c12264da\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.233446 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.233413    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjs8\" (UniqueName: \"kubernetes.io/projected/2ed90146-3693-4a19-9d4e-acfe96c829a8-kube-api-access-cmjs8\") pod \"cluster-proxy-proxy-agent-b749b56b9-7bzzr\" (UID: \"2ed90146-3693-4a19-9d4e-acfe96c829a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.314744 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314704    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79vbh\" (UniqueName: \"kubernetes.io/projected/2111f36b-3a34-4262-8653-27c5ba27dc8a-kube-api-access-79vbh\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.314744 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314746    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-tmp-dir\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.314997 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314787    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.314997 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314850    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.314997 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314912    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-config-volume\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.314997 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.314953    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89ppz\" (UniqueName: \"kubernetes.io/projected/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-kube-api-access-89ppz\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.314997 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.314972    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:14.315236 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.315045    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:14.815024493 +0000 UTC m=+33.722003434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:14.315236 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.315092    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:14.315236 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.315115    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-tmp-dir\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.315236 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.315154    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:14.815136457 +0000 UTC m=+33.722115395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:14.315523 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.315495    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-config-volume\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.322416 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.322388    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"
May 21 16:37:14.324929 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.324909    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ppz\" (UniqueName: \"kubernetes.io/projected/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-kube-api-access-89ppz\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.325036 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.324987    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79vbh\" (UniqueName: \"kubernetes.io/projected/2111f36b-3a34-4262-8653-27c5ba27dc8a-kube-api-access-79vbh\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.328592 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.328558    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:14.336338 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.336318    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:37:14.492843 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.492589    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq"]
May 21 16:37:14.493418 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.493391    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"]
May 21 16:37:14.506381 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.506356    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"]
May 21 16:37:14.602857 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:14.602755    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7af44d0a_6a6c_414a_ba26_f64fc0388e5c.slice/crio-f51973fd51cef330a543fa0073c2c5bbcb7eda1d398abbe95c776490e3bd5600 WatchSource:0}: Error finding container f51973fd51cef330a543fa0073c2c5bbcb7eda1d398abbe95c776490e3bd5600: Status 404 returned error can't find the container with id f51973fd51cef330a543fa0073c2c5bbcb7eda1d398abbe95c776490e3bd5600
May 21 16:37:14.603127 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:14.603098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ed90146_3693_4a19_9d4e_acfe96c829a8.slice/crio-38d6f7c2b0ef74ea92778b3f9dfeeecbcc81b0ef017ff5eb26be17c0a6a61a03 WatchSource:0}: Error finding container 38d6f7c2b0ef74ea92778b3f9dfeeecbcc81b0ef017ff5eb26be17c0a6a61a03: Status 404 returned error can't find the container with id 38d6f7c2b0ef74ea92778b3f9dfeeecbcc81b0ef017ff5eb26be17c0a6a61a03
May 21 16:37:14.603618 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:14.603578    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f107f3_dd5b_4973_9af6_1224c12264da.slice/crio-a519a4a0e5fa66b8eca9971c5f1d41941927cdbf58ad858206344ed4e78c8a40 WatchSource:0}: Error finding container a519a4a0e5fa66b8eca9971c5f1d41941927cdbf58ad858206344ed4e78c8a40: Status 404 returned error can't find the container with id a519a4a0e5fa66b8eca9971c5f1d41941927cdbf58ad858206344ed4e78c8a40
May 21 16:37:14.703079 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.703049    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:14.703079 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.703068    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:14.703258 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.703049    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:14.706742 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.706712    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 16:37:14.706864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.706783    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 16:37:14.706864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.706806    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 16:37:14.707000 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.706897    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5p9n4\""
May 21 16:37:14.707108 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.707095    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 16:37:14.707640 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.707624    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llnfd\""
May 21 16:37:14.721116 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.721097    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:14.721207 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.721141    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:14.721268 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.721223    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:14.721268 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.721231    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:14.721268 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.721236    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:14.721419 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.721286    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.721268394 +0000 UTC m=+34.628247329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:14.721419 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.721304    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.7212962 +0000 UTC m=+34.628275136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:14.821618 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.821586    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:14.822220 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.821691    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:14.822220 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.821721    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:14.822220 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.821770    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.821752241 +0000 UTC m=+34.728731194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:14.822220 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.821818    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:14.822220 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:14.821859    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:15.821845959 +0000 UTC m=+34.728824897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:14.823669 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.823646    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq" event={"ID":"7af44d0a-6a6c-414a-ba26-f64fc0388e5c","Type":"ContainerStarted","Data":"f51973fd51cef330a543fa0073c2c5bbcb7eda1d398abbe95c776490e3bd5600"}
May 21 16:37:14.824462 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.824445    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerStarted","Data":"38d6f7c2b0ef74ea92778b3f9dfeeecbcc81b0ef017ff5eb26be17c0a6a61a03"}
May 21 16:37:14.825301 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:14.825285    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" event={"ID":"14f107f3-dd5b-4973-9af6-1224c12264da","Type":"ContainerStarted","Data":"a519a4a0e5fa66b8eca9971c5f1d41941927cdbf58ad858206344ed4e78c8a40"}
May 21 16:37:15.426717 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.426681    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:15.426907 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.426758    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:15.427069 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.427047    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:37:15.427153 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.427133    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:37:47.427109429 +0000 UTC m=+66.334088382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : secret "metrics-daemon-secret" not found
May 21 16:37:15.431189 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.431165    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6cf\" (UniqueName: \"kubernetes.io/projected/3175078a-63ab-443b-93c5-d0ff348b1ab8-kube-api-access-zj6cf\") pod \"network-check-target-hxc5n\" (UID: \"3175078a-63ab-443b-93c5-d0ff348b1ab8\") " pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:15.528122 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.528086    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:15.530775 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.530750    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40589b6b-0b94-4d0d-93aa-f5c96a6455de-original-pull-secret\") pod \"global-pull-secret-syncer-q7qg5\" (UID: \"40589b6b-0b94-4d0d-93aa-f5c96a6455de\") " pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:15.614299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.614268    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7qg5"
May 21 16:37:15.620118 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.620096    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.729746    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.729817    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.730009    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.730073    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:17.730053842 +0000 UTC m=+36.637032800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.730143    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.730154    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:15.730568 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.730185    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:17.730173832 +0000 UTC m=+36.637152772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:15.792261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.792211    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7qg5"]
May 21 16:37:15.797651 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:15.797181    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40589b6b_0b94_4d0d_93aa_f5c96a6455de.slice/crio-4b274fd0af5ee0ff9e26db17a71c44c1cb125ef3f66ac3eeda3933c1be829135 WatchSource:0}: Error finding container 4b274fd0af5ee0ff9e26db17a71c44c1cb125ef3f66ac3eeda3933c1be829135: Status 404 returned error can't find the container with id 4b274fd0af5ee0ff9e26db17a71c44c1cb125ef3f66ac3eeda3933c1be829135
May 21 16:37:15.798672 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.798630    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxc5n"]
May 21 16:37:15.802683 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:37:15.802633    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3175078a_63ab_443b_93c5_d0ff348b1ab8.slice/crio-ad4230de1cd608b333fc350f5d0b452a4d8da78f2641ba88b23db1ced402a872 WatchSource:0}: Error finding container ad4230de1cd608b333fc350f5d0b452a4d8da78f2641ba88b23db1ced402a872: Status 404 returned error can't find the container with id ad4230de1cd608b333fc350f5d0b452a4d8da78f2641ba88b23db1ced402a872
May 21 16:37:15.829625 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.829586    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7qg5" event={"ID":"40589b6b-0b94-4d0d-93aa-f5c96a6455de","Type":"ContainerStarted","Data":"4b274fd0af5ee0ff9e26db17a71c44c1cb125ef3f66ac3eeda3933c1be829135"}
May 21 16:37:15.830218 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.830196    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:15.830320 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.830304    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:15.830625 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.830423    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:15.830625 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.830472    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:15.830625 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.830477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:17.830458911 +0000 UTC m=+36.737437863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:15.830625 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:15.830514    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:17.83050411 +0000 UTC m=+36.737483053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:15.831350 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.831257    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxc5n" event={"ID":"3175078a-63ab-443b-93c5-d0ff348b1ab8","Type":"ContainerStarted","Data":"ad4230de1cd608b333fc350f5d0b452a4d8da78f2641ba88b23db1ced402a872"}
May 21 16:37:15.834346 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.834180    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="3f6eb956a7f8e81e873325a070c7fc60ab1e9a752655fea972074af9f6746c2e" exitCode=0
May 21 16:37:15.834346 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:15.834232    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"3f6eb956a7f8e81e873325a070c7fc60ab1e9a752655fea972074af9f6746c2e"}
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:17.749116    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:17.749192    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.749347    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.749375    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.749398    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.749430    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:21.749410446 +0000 UTC m=+40.656389384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:17.749787 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.749468    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:21.749448599 +0000 UTC m=+40.656427553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:17.849627    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:17.850004    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.849792    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.850235    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:21.850217316 +0000 UTC m=+40.757196257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.850179    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:17.850658 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:17.850594    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:21.850579553 +0000 UTC m=+40.757558491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:21.784090 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:21.784053    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:21.784129    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.784230    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.784235    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.784250    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.784295    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:29.784275072 +0000 UTC m=+48.691254023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:21.784575 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.784316    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:29.784307947 +0000 UTC m=+48.691286889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:21.885218 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:21.885191    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:21.885369 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:21.885238    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:21.885369 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.885348    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:21.885449 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.885402    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:21.885449 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.885414    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:29.885396839 +0000 UTC m=+48.792375775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:21.885449 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:21.885437    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:29.88542692 +0000 UTC m=+48.792405856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:26.858631 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.858595    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7qg5" event={"ID":"40589b6b-0b94-4d0d-93aa-f5c96a6455de","Type":"ContainerStarted","Data":"7e51ffc24ee341ef08e932b0571e21153d920a1f59e576087ce03e1ccd0f7218"}
May 21 16:37:26.859881 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.859857    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxc5n" event={"ID":"3175078a-63ab-443b-93c5-d0ff348b1ab8","Type":"ContainerStarted","Data":"a14068e31b88adb797f5938bc8de67eade02afdbaf68144471c155a541407754"}
May 21 16:37:26.860046 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.859957    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:37:26.861953 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.861916    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="c0caccb6cce4b872928005174e007fc44a278a5457cd754c7c2243a66d87765b" exitCode=0
May 21 16:37:26.862086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.861961    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"c0caccb6cce4b872928005174e007fc44a278a5457cd754c7c2243a66d87765b"}
May 21 16:37:26.863326 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.863306    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerStarted","Data":"4dc86b07c65c593c4df28332e1a893a74d8766bd1fadd6ac229b8606fffb05d3"}
May 21 16:37:26.864491 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.864462    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq" event={"ID":"7af44d0a-6a6c-414a-ba26-f64fc0388e5c","Type":"ContainerStarted","Data":"8d2d575d3eac2d6459af9a3a9b907a5f2269943b4c7e4f225779970888513961"}
May 21 16:37:26.865679 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.865662    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" event={"ID":"14f107f3-dd5b-4973-9af6-1224c12264da","Type":"ContainerStarted","Data":"1f3067fb11b13db73d821456bcb43b94104c453b21243792662b564b40e7663e"}
May 21 16:37:26.865884 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.865869    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:26.867574 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.867555    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:37:26.874068 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.874033    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q7qg5" podStartSLOduration=33.873413017 podStartE2EDuration="43.874022472s" podCreationTimestamp="2026-05-21 16:36:43 +0000 UTC" firstStartedPulling="2026-05-21 16:37:15.803502769 +0000 UTC m=+34.710481708" lastFinishedPulling="2026-05-21 16:37:25.804112225 +0000 UTC m=+44.711091163" observedRunningTime="2026-05-21 16:37:26.873363262 +0000 UTC m=+45.780342220" watchObservedRunningTime="2026-05-21 16:37:26.874022472 +0000 UTC m=+45.781001429"
May 21 16:37:26.888358 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.888323    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxc5n" podStartSLOduration=34.893481546 podStartE2EDuration="44.888310472s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:37:15.808915514 +0000 UTC m=+34.715894454" lastFinishedPulling="2026-05-21 16:37:25.80374444 +0000 UTC m=+44.710723380" observedRunningTime="2026-05-21 16:37:26.888031251 +0000 UTC m=+45.795010211" watchObservedRunningTime="2026-05-21 16:37:26.888310472 +0000 UTC m=+45.795289430"
May 21 16:37:26.901161 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.901129    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq" podStartSLOduration=33.703297294 podStartE2EDuration="44.901119613s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:37:14.604654797 +0000 UTC m=+33.511633732" lastFinishedPulling="2026-05-21 16:37:25.802477112 +0000 UTC m=+44.709456051" observedRunningTime="2026-05-21 16:37:26.900919985 +0000 UTC m=+45.807898944" watchObservedRunningTime="2026-05-21 16:37:26.901119613 +0000 UTC m=+45.808098570"
May 21 16:37:26.934689 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:26.934654    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" podStartSLOduration=33.320430222 podStartE2EDuration="44.934644362s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:37:14.605399581 +0000 UTC m=+33.512378517" lastFinishedPulling="2026-05-21 16:37:26.219613704 +0000 UTC m=+45.126592657" observedRunningTime="2026-05-21 16:37:26.933811617 +0000 UTC m=+45.840790577" watchObservedRunningTime="2026-05-21 16:37:26.934644362 +0000 UTC m=+45.841623319"
May 21 16:37:29.851952 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.851893    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.851991    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.852045    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.852071    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.852107    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.852134    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:45.852117181 +0000 UTC m=+64.759096117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:29.852387 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.852156    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:37:45.852139572 +0000 UTC m=+64.759118510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:29.872452 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.872417    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerStarted","Data":"4c10e555389a5039435e678ae32dc247f5c6220f7f2e2acfeac3b29f9c83ec52"}
May 21 16:37:29.872452 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.872448    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerStarted","Data":"9807794e12d13c9a4eff12be55ab590356a3f039d618ddeb35955742ff63fba3"}
May 21 16:37:29.890582 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.890544    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" podStartSLOduration=33.674712536 podStartE2EDuration="47.890531273s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:37:14.605085776 +0000 UTC m=+33.512064715" lastFinishedPulling="2026-05-21 16:37:28.820904502 +0000 UTC m=+47.727883452" observedRunningTime="2026-05-21 16:37:29.889577842 +0000 UTC m=+48.796556800" watchObservedRunningTime="2026-05-21 16:37:29.890531273 +0000 UTC m=+48.797510230"
May 21 16:37:29.952853 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.952822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:29.953078 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:29.953055    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:29.953158 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.953084    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:29.953158 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.953148    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:45.953127243 +0000 UTC m=+64.860106196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:29.953532 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.953497    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:29.953638 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:29.953548    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:37:45.9535336 +0000 UTC m=+64.860512541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:33.882705 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:33.882675    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="da21484aa50741caa8b9b9627f6551a67e2faea074af40e9a58c48307559f38d" exitCode=0
May 21 16:37:33.883090 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:33.882737    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"da21484aa50741caa8b9b9627f6551a67e2faea074af40e9a58c48307559f38d"}
May 21 16:37:34.888329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:34.888298    2559 generic.go:358] "Generic (PLEG): container finished" podID="c99c241b-a610-4932-885d-c36fcf4af460" containerID="947dacaee1df1340c894674d0773126d63a74578b4a0ad2bdc5b0e8693f497de" exitCode=0
May 21 16:37:34.888726 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:34.888364    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerDied","Data":"947dacaee1df1340c894674d0773126d63a74578b4a0ad2bdc5b0e8693f497de"}
May 21 16:37:35.894341 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:35.894303    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" event={"ID":"c99c241b-a610-4932-885d-c36fcf4af460","Type":"ContainerStarted","Data":"4e190019598730b9554badc4666db2ad6e5a927f0f42a2b3a39747dc51ff4e22"}
May 21 16:37:35.919194 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:35.919151    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b9b9d" podStartSLOduration=5.956161548 podStartE2EDuration="54.919139153s" podCreationTimestamp="2026-05-21 16:36:41 +0000 UTC" firstStartedPulling="2026-05-21 16:36:44.499371492 +0000 UTC m=+3.406350428" lastFinishedPulling="2026-05-21 16:37:33.462349098 +0000 UTC m=+52.369328033" observedRunningTime="2026-05-21 16:37:35.917246213 +0000 UTC m=+54.824225169" watchObservedRunningTime="2026-05-21 16:37:35.919139153 +0000 UTC m=+54.826118110"
May 21 16:37:39.824659 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:39.824629    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hnwh"
May 21 16:37:45.873046 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:45.872986    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:45.873069    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.873130    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.873148    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.873183    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.873199    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:38:17.873183961 +0000 UTC m=+96.780162902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:37:45.873482 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.873238    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:38:17.873223537 +0000 UTC m=+96.780202476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:37:45.974369 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:45.974341    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:37:45.974510 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:45.974390    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:37:45.974510 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.974477    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:37:45.974510 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.974484    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:37:45.974621 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.974520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:38:17.974507213 +0000 UTC m=+96.881486149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:37:45.974621 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:45.974534    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:38:17.974528575 +0000 UTC m=+96.881507511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:37:47.486657 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:47.486623    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:37:47.487044 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:47.486741    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:37:47.487044 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:37:47.486792    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:38:51.486777998 +0000 UTC m=+130.393756934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : secret "metrics-daemon-secret" not found
May 21 16:37:57.869810 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:37:57.869781    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxc5n"
May 21 16:38:17.915794 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:38:17.915646    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:38:17.915794 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:38:17.915707    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:38:17.916319 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:17.915806    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:38:17.916319 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:17.915827    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:38:17.916319 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:17.915806    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:38:17.916319 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:17.915883    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:21.915866156 +0000 UTC m=+160.822845092 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:38:17.916319 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:17.915895    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:21.915889377 +0000 UTC m=+160.822868313 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:38:18.016611 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:38:18.016585    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:38:18.016748 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:38:18.016630    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:38:18.016748 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:18.016723    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:38:18.016748 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:18.016731    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:38:18.016850 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:18.016781    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:39:22.016764281 +0000 UTC m=+160.923743219 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:38:18.016850 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:18.016794    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:39:22.016787699 +0000 UTC m=+160.923766634 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:38:51.566796 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:38:51.566758    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:38:51.567289 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:51.566904    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 16:38:51.567289 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:38:51.566992    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs podName:bf3aa270-6245-4d85-80c4-d7a428ae658b nodeName:}" failed. No retries permitted until 2026-05-21 16:40:53.566975488 +0000 UTC m=+252.473954428 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs") pod "network-metrics-daemon-78bbj" (UID: "bf3aa270-6245-4d85-80c4-d7a428ae658b") : secret "metrics-daemon-secret" not found
May 21 16:39:06.197324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:06.197295    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjk2q_dc63d811-c624-43ca-932f-cbed4e185260/dns-node-resolver/0.log"
May 21 16:39:07.200190 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:07.200163    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9v4xh_429870d1-37a9-4902-a7e6-9f907b0cf382/node-ca/0.log"
May 21 16:39:16.977366 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:16.977322    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk" podUID="6e98cd3f-9991-4e95-971a-4f658ef6b0e4"
May 21 16:39:16.989700 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:16.989662    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx" podUID="1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"
May 21 16:39:17.067234 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:17.067201    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mmlw9" podUID="e2814a31-d63c-41f6-8a1c-fdc3adbc305a"
May 21 16:39:17.072351 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:17.072329    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dl7vd" podUID="2111f36b-3a34-4262-8653-27c5ba27dc8a"
May 21 16:39:17.123582 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.123562    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:39:17.123681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.123592    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmlw9"
May 21 16:39:17.123681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.123562    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:39:17.123681 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.123562    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:39:17.660549 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.660516    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q5k82"]
May 21 16:39:17.662708 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.662687    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.665837 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.665802    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 16:39:17.666028 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.666009    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 16:39:17.666087 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.666054    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hbwcw\""
May 21 16:39:17.666442 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.666426    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 16:39:17.666557 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.666543    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 16:39:17.679614 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.679595    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5k82"]
May 21 16:39:17.724312 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:17.724279    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-78bbj" podUID="bf3aa270-6245-4d85-80c4-d7a428ae658b"
May 21 16:39:17.763505 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.763478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhbj\" (UniqueName: \"kubernetes.io/projected/61605b25-fe7e-4368-84c7-3f68d9654029-kube-api-access-gwhbj\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.763612 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.763541    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61605b25-fe7e-4368-84c7-3f68d9654029-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.763612 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.763592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61605b25-fe7e-4368-84c7-3f68d9654029-crio-socket\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.763721 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.763676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.763774 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.763730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61605b25-fe7e-4368-84c7-3f68d9654029-data-volume\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.864971 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.864921    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61605b25-fe7e-4368-84c7-3f68d9654029-data-volume\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.864978    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhbj\" (UniqueName: \"kubernetes.io/projected/61605b25-fe7e-4368-84c7-3f68d9654029-kube-api-access-gwhbj\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865021    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61605b25-fe7e-4368-84c7-3f68d9654029-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865053    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61605b25-fe7e-4368-84c7-3f68d9654029-crio-socket\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865107    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865354 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:17.865202    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 16:39:17.865354 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865210    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61605b25-fe7e-4368-84c7-3f68d9654029-crio-socket\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865354 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:17.865260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls podName:61605b25-fe7e-4368-84c7-3f68d9654029 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:18.365244575 +0000 UTC m=+157.272223512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q5k82" (UID: "61605b25-fe7e-4368-84c7-3f68d9654029") : secret "insights-runtime-extractor-tls" not found
May 21 16:39:17.865354 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61605b25-fe7e-4368-84c7-3f68d9654029-data-volume\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.865526 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.865510    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61605b25-fe7e-4368-84c7-3f68d9654029-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:17.874625 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:17.874598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhbj\" (UniqueName: \"kubernetes.io/projected/61605b25-fe7e-4368-84c7-3f68d9654029-kube-api-access-gwhbj\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:18.370114 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:18.370028    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:18.370474 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:18.370150    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 16:39:18.370474 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:18.370215    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls podName:61605b25-fe7e-4368-84c7-3f68d9654029 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:19.370197559 +0000 UTC m=+158.277176496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q5k82" (UID: "61605b25-fe7e-4368-84c7-3f68d9654029") : secret "insights-runtime-extractor-tls" not found
May 21 16:39:19.378230 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:19.378174    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:19.378632 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:19.378321    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 16:39:19.378632 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:19.378384    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls podName:61605b25-fe7e-4368-84c7-3f68d9654029 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:21.378367816 +0000 UTC m=+160.285346757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q5k82" (UID: "61605b25-fe7e-4368-84c7-3f68d9654029") : secret "insights-runtime-extractor-tls" not found
May 21 16:39:21.393022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:21.392976    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:21.393397 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.393128    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 16:39:21.393397 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.393193    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls podName:61605b25-fe7e-4368-84c7-3f68d9654029 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:25.393177361 +0000 UTC m=+164.300156301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q5k82" (UID: "61605b25-fe7e-4368-84c7-3f68d9654029") : secret "insights-runtime-extractor-tls" not found
May 21 16:39:21.998651 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:21.998609    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") pod \"image-registry-6656c5fcf6-jl2gx\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") " pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:39:21.998834 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:21.998678    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:39:21.998834 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.998753    2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 16:39:21.998834 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.998768    2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6656c5fcf6-jl2gx: secret "image-registry-tls" not found
May 21 16:39:21.998834 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.998777    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 16:39:21.998834 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.998827    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls podName:1e3a91f6-472d-4814-8b3b-27ba4f6c7db1 nodeName:}" failed. No retries permitted until 2026-05-21 16:41:23.998810007 +0000 UTC m=+282.905788947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls") pod "image-registry-6656c5fcf6-jl2gx" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1") : secret "image-registry-tls" not found
May 21 16:39:21.999026 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:21.998840    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert podName:6e98cd3f-9991-4e95-971a-4f658ef6b0e4 nodeName:}" failed. No retries permitted until 2026-05-21 16:41:23.998834478 +0000 UTC m=+282.905813415 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-6dvtk" (UID: "6e98cd3f-9991-4e95-971a-4f658ef6b0e4") : secret "networking-console-plugin-cert" not found
May 21 16:39:22.099880 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:22.099853    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:39:22.100032 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:22.099926    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:39:22.100032 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:22.100000    2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 16:39:22.100032 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:22.100009    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 16:39:22.100130 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:22.100057    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert podName:2111f36b-3a34-4262-8653-27c5ba27dc8a nodeName:}" failed. No retries permitted until 2026-05-21 16:41:24.100039868 +0000 UTC m=+283.007018804 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert") pod "ingress-canary-dl7vd" (UID: "2111f36b-3a34-4262-8653-27c5ba27dc8a") : secret "canary-serving-cert" not found
May 21 16:39:22.100130 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:22.100076    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls podName:e2814a31-d63c-41f6-8a1c-fdc3adbc305a nodeName:}" failed. No retries permitted until 2026-05-21 16:41:24.100067208 +0000 UTC m=+283.007046146 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls") pod "dns-default-mmlw9" (UID: "e2814a31-d63c-41f6-8a1c-fdc3adbc305a") : secret "dns-default-metrics-tls" not found
May 21 16:39:25.428179 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:25.428141    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:25.428569 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:25.428256    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 16:39:25.428569 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:39:25.428311    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls podName:61605b25-fe7e-4368-84c7-3f68d9654029 nodeName:}" failed. No retries permitted until 2026-05-21 16:39:33.428297405 +0000 UTC m=+172.335276342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q5k82" (UID: "61605b25-fe7e-4368-84c7-3f68d9654029") : secret "insights-runtime-extractor-tls" not found
May 21 16:39:26.145959 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:26.145913    2559 generic.go:358] "Generic (PLEG): container finished" podID="7af44d0a-6a6c-414a-ba26-f64fc0388e5c" containerID="8d2d575d3eac2d6459af9a3a9b907a5f2269943b4c7e4f225779970888513961" exitCode=255
May 21 16:39:26.146104 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:26.145970    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq" event={"ID":"7af44d0a-6a6c-414a-ba26-f64fc0388e5c","Type":"ContainerDied","Data":"8d2d575d3eac2d6459af9a3a9b907a5f2269943b4c7e4f225779970888513961"}
May 21 16:39:26.146252 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:26.146237    2559 scope.go:117] "RemoveContainer" containerID="8d2d575d3eac2d6459af9a3a9b907a5f2269943b4c7e4f225779970888513961"
May 21 16:39:26.866361 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:26.866320    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" podUID="14f107f3-dd5b-4973-9af6-1224c12264da" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
May 21 16:39:27.149481 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:27.149396    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ff554864b-2llhq" event={"ID":"7af44d0a-6a6c-414a-ba26-f64fc0388e5c","Type":"ContainerStarted","Data":"f7844fd409a35efe6a46824c99a7109dc885f72c2bcabfba28d38076494277ea"}
May 21 16:39:27.154170 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:27.154135    2559 generic.go:358] "Generic (PLEG): container finished" podID="14f107f3-dd5b-4973-9af6-1224c12264da" containerID="1f3067fb11b13db73d821456bcb43b94104c453b21243792662b564b40e7663e" exitCode=1
May 21 16:39:27.154294 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:27.154192    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" event={"ID":"14f107f3-dd5b-4973-9af6-1224c12264da","Type":"ContainerDied","Data":"1f3067fb11b13db73d821456bcb43b94104c453b21243792662b564b40e7663e"}
May 21 16:39:27.154508 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:27.154494    2559 scope.go:117] "RemoveContainer" containerID="1f3067fb11b13db73d821456bcb43b94104c453b21243792662b564b40e7663e"
May 21 16:39:28.157880 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:28.157851    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99" event={"ID":"14f107f3-dd5b-4973-9af6-1224c12264da","Type":"ContainerStarted","Data":"1c75aeae43ca6075b167f338e210f37bc11e41ec5a4fd7313b217cf67da0a8c1"}
May 21 16:39:28.158261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:28.158136    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:39:28.158752 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:28.158731    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68bb88f766-scb99"
May 21 16:39:30.703355 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:30.703286    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:39:33.495848 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:33.495797    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:33.498039 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:33.498019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61605b25-fe7e-4368-84c7-3f68d9654029-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5k82\" (UID: \"61605b25-fe7e-4368-84c7-3f68d9654029\") " pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:33.571354 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:33.571322    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5k82"
May 21 16:39:33.692892 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:33.692864    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5k82"]
May 21 16:39:33.695695 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:39:33.695667    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61605b25_fe7e_4368_84c7_3f68d9654029.slice/crio-96d33874ec7c26a306b530e1d4b58603dd4a2e3e1abbbe41a254ed1516af1b4f WatchSource:0}: Error finding container 96d33874ec7c26a306b530e1d4b58603dd4a2e3e1abbbe41a254ed1516af1b4f: Status 404 returned error can't find the container with id 96d33874ec7c26a306b530e1d4b58603dd4a2e3e1abbbe41a254ed1516af1b4f
May 21 16:39:34.172088 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:34.172056    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5k82" event={"ID":"61605b25-fe7e-4368-84c7-3f68d9654029","Type":"ContainerStarted","Data":"9a86907da231be42dd7b0db876ee34a0a6775c34d83adc8480d13fbfb3ba5af8"}
May 21 16:39:34.172088 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:34.172089    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5k82" event={"ID":"61605b25-fe7e-4368-84c7-3f68d9654029","Type":"ContainerStarted","Data":"96d33874ec7c26a306b530e1d4b58603dd4a2e3e1abbbe41a254ed1516af1b4f"}
May 21 16:39:35.176290 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:35.176251    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5k82" event={"ID":"61605b25-fe7e-4368-84c7-3f68d9654029","Type":"ContainerStarted","Data":"c0a7f7fefee1275a15f079e2b5b6b0bb9ab8b989f46c1b3c3e8069f1b68fbbe4"}
May 21 16:39:36.180056 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:36.180016    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5k82" event={"ID":"61605b25-fe7e-4368-84c7-3f68d9654029","Type":"ContainerStarted","Data":"312a3879673e42bc0c6fe0949ba21fe371aa38bfb7c839925d86945c707dd37f"}
May 21 16:39:36.203780 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:36.203685    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q5k82" podStartSLOduration=17.016617493 podStartE2EDuration="19.203670878s" podCreationTimestamp="2026-05-21 16:39:17 +0000 UTC" firstStartedPulling="2026-05-21 16:39:33.754335098 +0000 UTC m=+172.661314034" lastFinishedPulling="2026-05-21 16:39:35.941388481 +0000 UTC m=+174.848367419" observedRunningTime="2026-05-21 16:39:36.203115138 +0000 UTC m=+175.110094088" watchObservedRunningTime="2026-05-21 16:39:36.203670878 +0000 UTC m=+175.110649835"
May 21 16:39:49.276575 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.276542    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dlg9h"]
May 21 16:39:49.278431 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.278416    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.282213 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.282192    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 16:39:49.282343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.282274    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 16:39:49.282343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.282282    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 16:39:49.282683 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.282661    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 16:39:49.282773 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.282759    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 16:39:49.283166 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.283151    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zfrl8\""
May 21 16:39:49.283362 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.283347    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 16:39:49.320003 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.319977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320123 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-root\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320123 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320123 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-tls\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320223 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56qw7\" (UniqueName: \"kubernetes.io/projected/e61012a8-1d52-4a7d-a7e7-7b98df88979d-kube-api-access-56qw7\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320223 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-wtmp\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320223 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-metrics-client-ca\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320223 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-sys\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.320339 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.320242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-textfile\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421522 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421493    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421547    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-tls\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421573    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56qw7\" (UniqueName: \"kubernetes.io/projected/e61012a8-1d52-4a7d-a7e7-7b98df88979d-kube-api-access-56qw7\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421592    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-wtmp\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421610    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-metrics-client-ca\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421643    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-sys\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.421697 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421667    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-textfile\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421767    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-sys\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421818    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-wtmp\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421880    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.421958    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-root\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.422019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-textfile\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422214 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.422038    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e61012a8-1d52-4a7d-a7e7-7b98df88979d-root\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422214 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.422155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.422276 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.422227    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e61012a8-1d52-4a7d-a7e7-7b98df88979d-metrics-client-ca\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.424015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.423997    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-tls\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.424118 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.424050    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e61012a8-1d52-4a7d-a7e7-7b98df88979d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.437184 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.437158    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56qw7\" (UniqueName: \"kubernetes.io/projected/e61012a8-1d52-4a7d-a7e7-7b98df88979d-kube-api-access-56qw7\") pod \"node-exporter-dlg9h\" (UID: \"e61012a8-1d52-4a7d-a7e7-7b98df88979d\") " pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.587532 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:49.587461    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlg9h"
May 21 16:39:49.596521 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:39:49.596490    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61012a8_1d52_4a7d_a7e7_7b98df88979d.slice/crio-3786d353542f7f1ddf60e203af00d8aac57dde662da35322882d9da960f553ec WatchSource:0}: Error finding container 3786d353542f7f1ddf60e203af00d8aac57dde662da35322882d9da960f553ec: Status 404 returned error can't find the container with id 3786d353542f7f1ddf60e203af00d8aac57dde662da35322882d9da960f553ec
May 21 16:39:50.214392 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:50.214356    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlg9h" event={"ID":"e61012a8-1d52-4a7d-a7e7-7b98df88979d","Type":"ContainerStarted","Data":"3786d353542f7f1ddf60e203af00d8aac57dde662da35322882d9da960f553ec"}
May 21 16:39:51.221341 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:51.221307    2559 generic.go:358] "Generic (PLEG): container finished" podID="e61012a8-1d52-4a7d-a7e7-7b98df88979d" containerID="96ab672e90df2fe7e8e1a967a7bc02a4f6ab902b09fd7fbc1863a0028dae7644" exitCode=0
May 21 16:39:51.221712 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:51.221365    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlg9h" event={"ID":"e61012a8-1d52-4a7d-a7e7-7b98df88979d","Type":"ContainerDied","Data":"96ab672e90df2fe7e8e1a967a7bc02a4f6ab902b09fd7fbc1863a0028dae7644"}
May 21 16:39:52.225671 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:52.225633    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlg9h" event={"ID":"e61012a8-1d52-4a7d-a7e7-7b98df88979d","Type":"ContainerStarted","Data":"9e97c476f4d85493345105656a71fd1e75c0a233d027dbcce9b6afa5d0ad6124"}
May 21 16:39:52.225671 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:52.225669    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlg9h" event={"ID":"e61012a8-1d52-4a7d-a7e7-7b98df88979d","Type":"ContainerStarted","Data":"1f04dd5675efac2a28c3d7bd6db3ef256699798bdee2d13c0776e3c16548c345"}
May 21 16:39:52.244046 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:39:52.244004    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dlg9h" podStartSLOduration=2.148174554 podStartE2EDuration="3.243990653s" podCreationTimestamp="2026-05-21 16:39:49 +0000 UTC" firstStartedPulling="2026-05-21 16:39:49.598506701 +0000 UTC m=+188.505485640" lastFinishedPulling="2026-05-21 16:39:50.6943228 +0000 UTC m=+189.601301739" observedRunningTime="2026-05-21 16:39:52.243226037 +0000 UTC m=+191.150204999" watchObservedRunningTime="2026-05-21 16:39:52.243990653 +0000 UTC m=+191.150969631"
May 21 16:40:04.287710 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:04.287676    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6656c5fcf6-jl2gx"]
May 21 16:40:04.288106 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:40:04.287874    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx" podUID="1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"
May 21 16:40:05.256347 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.256318    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:40:05.260245 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.260225    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:40:05.352550 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352515    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352562    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352616    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352641    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352660    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352677    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnlst\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352698    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates\") pod \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\" (UID: \"1e3a91f6-472d-4814-8b3b-27ba4f6c7db1\") "
May 21 16:40:05.353016 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.352888    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 16:40:05.353386 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.353103    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:40:05.353386 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.353262    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 16:40:05.355054 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.355027    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:40:05.355178 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.355076    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst" (OuterVolumeSpecName: "kube-api-access-bnlst") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "kube-api-access-bnlst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:40:05.355178 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.355156    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 16:40:05.355279 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.355263    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" (UID: "1e3a91f6-472d-4814-8b3b-27ba4f6c7db1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:40:05.453594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453546    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-ca-trust-extracted\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453587    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-image-registry-private-configuration\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453600    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-trusted-ca\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453609    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-installation-pull-secrets\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453618    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnlst\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-kube-api-access-bnlst\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453894 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453626    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-certificates\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:05.453894 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:05.453636    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-bound-sa-token\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:06.258977 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:06.258927    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6656c5fcf6-jl2gx"
May 21 16:40:06.293491 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:06.293456    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6656c5fcf6-jl2gx"]
May 21 16:40:06.296786 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:06.296759    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6656c5fcf6-jl2gx"]
May 21 16:40:06.360676 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:06.360647    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1-registry-tls\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:40:07.705512 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:07.705480    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3a91f6-472d-4814-8b3b-27ba4f6c7db1" path="/var/lib/kubelet/pods/1e3a91f6-472d-4814-8b3b-27ba4f6c7db1/volumes"
May 21 16:40:24.337601 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:24.337562    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" podUID="2ed90146-3693-4a19-9d4e-acfe96c829a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:40:34.337120 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:34.337079    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" podUID="2ed90146-3693-4a19-9d4e-acfe96c829a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:40:44.337900 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:44.337858    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" podUID="2ed90146-3693-4a19-9d4e-acfe96c829a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 16:40:44.338358 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:44.337957    2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr"
May 21 16:40:44.338419 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:44.338391    2559 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4c10e555389a5039435e678ae32dc247f5c6220f7f2e2acfeac3b29f9c83ec52"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 16:40:44.338473 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:44.338458    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" podUID="2ed90146-3693-4a19-9d4e-acfe96c829a8" containerName="service-proxy" containerID="cri-o://4c10e555389a5039435e678ae32dc247f5c6220f7f2e2acfeac3b29f9c83ec52" gracePeriod=30
May 21 16:40:45.353371 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:45.353339    2559 generic.go:358] "Generic (PLEG): container finished" podID="2ed90146-3693-4a19-9d4e-acfe96c829a8" containerID="4c10e555389a5039435e678ae32dc247f5c6220f7f2e2acfeac3b29f9c83ec52" exitCode=2
May 21 16:40:45.353741 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:45.353387    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerDied","Data":"4c10e555389a5039435e678ae32dc247f5c6220f7f2e2acfeac3b29f9c83ec52"}
May 21 16:40:45.353741 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:45.353408    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b749b56b9-7bzzr" event={"ID":"2ed90146-3693-4a19-9d4e-acfe96c829a8","Type":"ContainerStarted","Data":"a43e0254fe5e28e0aacfd3bd141b86f0fd9d7596573c0666dac9446f83fc5aab"}
May 21 16:40:53.607977 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:53.607919    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:40:53.609999 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:53.609977    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3aa270-6245-4d85-80c4-d7a428ae658b-metrics-certs\") pod \"network-metrics-daemon-78bbj\" (UID: \"bf3aa270-6245-4d85-80c4-d7a428ae658b\") " pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:40:53.806222 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:53.806193    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llnfd\""
May 21 16:40:53.814908 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:53.814880    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-78bbj"
May 21 16:40:53.932072 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:53.932040    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-78bbj"]
May 21 16:40:53.935314 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:40:53.935287    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3aa270_6245_4d85_80c4_d7a428ae658b.slice/crio-6df2e8b18013376edf07359fb7bdd72f07d453e7498286e65bca15e4d25f94c4 WatchSource:0}: Error finding container 6df2e8b18013376edf07359fb7bdd72f07d453e7498286e65bca15e4d25f94c4: Status 404 returned error can't find the container with id 6df2e8b18013376edf07359fb7bdd72f07d453e7498286e65bca15e4d25f94c4
May 21 16:40:54.374487 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:54.374453    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-78bbj" event={"ID":"bf3aa270-6245-4d85-80c4-d7a428ae658b","Type":"ContainerStarted","Data":"6df2e8b18013376edf07359fb7bdd72f07d453e7498286e65bca15e4d25f94c4"}
May 21 16:40:55.378715 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:55.378634    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-78bbj" event={"ID":"bf3aa270-6245-4d85-80c4-d7a428ae658b","Type":"ContainerStarted","Data":"4fc45d6e1cad7abb0f86d06e34e29a85e9ae8413e4f387fcc13d70655bae23bc"}
May 21 16:40:55.378715 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:55.378680    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-78bbj" event={"ID":"bf3aa270-6245-4d85-80c4-d7a428ae658b","Type":"ContainerStarted","Data":"00fd97ca5c28e740a5223e1bfd7f5b096e38294e3c8a256f182c371fcda88b83"}
May 21 16:40:55.394812 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:40:55.394768    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-78bbj" podStartSLOduration=252.234284126 podStartE2EDuration="4m13.394755424s" podCreationTimestamp="2026-05-21 16:36:42 +0000 UTC" firstStartedPulling="2026-05-21 16:40:53.937032047 +0000 UTC m=+252.844010983" lastFinishedPulling="2026-05-21 16:40:55.097503344 +0000 UTC m=+254.004482281" observedRunningTime="2026-05-21 16:40:55.393972363 +0000 UTC m=+254.300951323" watchObservedRunningTime="2026-05-21 16:40:55.394755424 +0000 UTC m=+254.301734382"
May 21 16:41:20.124417 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:41:20.124361    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dl7vd" podUID="2111f36b-3a34-4262-8653-27c5ba27dc8a"
May 21 16:41:20.124417 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:41:20.124363    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mmlw9" podUID="e2814a31-d63c-41f6-8a1c-fdc3adbc305a"
May 21 16:41:20.124417 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:41:20.124369    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk" podUID="6e98cd3f-9991-4e95-971a-4f658ef6b0e4"
May 21 16:41:20.438857 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:20.438778    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:41:20.438857 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:20.438814    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:41:20.439050 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:20.438962    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:24.027359 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.027324    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:41:24.029642 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.029619    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e98cd3f-9991-4e95-971a-4f658ef6b0e4-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-6dvtk\" (UID: \"6e98cd3f-9991-4e95-971a-4f658ef6b0e4\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:41:24.041966 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.041924    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k5t46\""
May 21 16:41:24.050088 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.050074    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"
May 21 16:41:24.128415 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.128385    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:24.128545 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.128445    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:41:24.130671 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.130649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2814a31-d63c-41f6-8a1c-fdc3adbc305a-metrics-tls\") pod \"dns-default-mmlw9\" (UID: \"e2814a31-d63c-41f6-8a1c-fdc3adbc305a\") " pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:24.130864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.130845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2111f36b-3a34-4262-8653-27c5ba27dc8a-cert\") pod \"ingress-canary-dl7vd\" (UID: \"2111f36b-3a34-4262-8653-27c5ba27dc8a\") " pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:41:24.169062 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.169031    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk"]
May 21 16:41:24.171803 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:41:24.171776    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e98cd3f_9991_4e95_971a_4f658ef6b0e4.slice/crio-105e50108fabf6b836165bbb01c630b71261782905f1fb61f3464a352ae025b4 WatchSource:0}: Error finding container 105e50108fabf6b836165bbb01c630b71261782905f1fb61f3464a352ae025b4: Status 404 returned error can't find the container with id 105e50108fabf6b836165bbb01c630b71261782905f1fb61f3464a352ae025b4
May 21 16:41:24.341800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.341711    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rk5f9\""
May 21 16:41:24.341970 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.341813    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2nz4g\""
May 21 16:41:24.350511 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.350492    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:24.350614 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.350493    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dl7vd"
May 21 16:41:24.455215 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.455184    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk" event={"ID":"6e98cd3f-9991-4e95-971a-4f658ef6b0e4","Type":"ContainerStarted","Data":"105e50108fabf6b836165bbb01c630b71261782905f1fb61f3464a352ae025b4"}
May 21 16:41:24.476000 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.475969    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dl7vd"]
May 21 16:41:24.479018 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:41:24.478992    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2111f36b_3a34_4262_8653_27c5ba27dc8a.slice/crio-8a020808883b74a5ffa898b50b9fd5dffbac3df20aee4e02acc55e94f3bd1835 WatchSource:0}: Error finding container 8a020808883b74a5ffa898b50b9fd5dffbac3df20aee4e02acc55e94f3bd1835: Status 404 returned error can't find the container with id 8a020808883b74a5ffa898b50b9fd5dffbac3df20aee4e02acc55e94f3bd1835
May 21 16:41:24.493855 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:24.493828    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmlw9"]
May 21 16:41:24.496631 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:41:24.496607    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2814a31_d63c_41f6_8a1c_fdc3adbc305a.slice/crio-9fd8f31c53f3ea072e7c0d37d721f94574a2a78ef46662d72a56084515c6b6a9 WatchSource:0}: Error finding container 9fd8f31c53f3ea072e7c0d37d721f94574a2a78ef46662d72a56084515c6b6a9: Status 404 returned error can't find the container with id 9fd8f31c53f3ea072e7c0d37d721f94574a2a78ef46662d72a56084515c6b6a9
May 21 16:41:25.460110 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:25.460071    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmlw9" event={"ID":"e2814a31-d63c-41f6-8a1c-fdc3adbc305a","Type":"ContainerStarted","Data":"9fd8f31c53f3ea072e7c0d37d721f94574a2a78ef46662d72a56084515c6b6a9"}
May 21 16:41:25.461263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:25.461216    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl7vd" event={"ID":"2111f36b-3a34-4262-8653-27c5ba27dc8a","Type":"ContainerStarted","Data":"8a020808883b74a5ffa898b50b9fd5dffbac3df20aee4e02acc55e94f3bd1835"}
May 21 16:41:26.465821 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:26.465775    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk" event={"ID":"6e98cd3f-9991-4e95-971a-4f658ef6b0e4","Type":"ContainerStarted","Data":"71361f1523b4e323fcb39880ae1c8991dc5aaaaab16b28eb251519fefea61c5c"}
May 21 16:41:27.469733 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.469697    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dl7vd" event={"ID":"2111f36b-3a34-4262-8653-27c5ba27dc8a","Type":"ContainerStarted","Data":"cc2521eaf4ae8a76162a24a789a3eecb3fd4323ee937a8c50c98ef3f8dcebe49"}
May 21 16:41:27.471174 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.471151    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmlw9" event={"ID":"e2814a31-d63c-41f6-8a1c-fdc3adbc305a","Type":"ContainerStarted","Data":"96ae37d80ef2cc228c43bf9524af759f977966e10fae8feb53e9361b0d0c3747"}
May 21 16:41:27.471281 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.471181    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmlw9" event={"ID":"e2814a31-d63c-41f6-8a1c-fdc3adbc305a","Type":"ContainerStarted","Data":"97e2f3aeac5bdd072b323586aae4c7dd674ccbb74146f030f57585fb5b7076a4"}
May 21 16:41:27.486113 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.486073    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-6dvtk" podStartSLOduration=264.120365109 podStartE2EDuration="4m25.486061118s" podCreationTimestamp="2026-05-21 16:37:02 +0000 UTC" firstStartedPulling="2026-05-21 16:41:24.173434095 +0000 UTC m=+283.080413031" lastFinishedPulling="2026-05-21 16:41:25.539130095 +0000 UTC m=+284.446109040" observedRunningTime="2026-05-21 16:41:26.480668198 +0000 UTC m=+285.387647156" watchObservedRunningTime="2026-05-21 16:41:27.486061118 +0000 UTC m=+286.393040086"
May 21 16:41:27.486221 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.486174    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dl7vd" podStartSLOduration=252.372355222 podStartE2EDuration="4m14.486170387s" podCreationTimestamp="2026-05-21 16:37:13 +0000 UTC" firstStartedPulling="2026-05-21 16:41:24.480737727 +0000 UTC m=+283.387716663" lastFinishedPulling="2026-05-21 16:41:26.594552885 +0000 UTC m=+285.501531828" observedRunningTime="2026-05-21 16:41:27.485545303 +0000 UTC m=+286.392524262" watchObservedRunningTime="2026-05-21 16:41:27.486170387 +0000 UTC m=+286.393149339"
May 21 16:41:27.501616 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:27.501578    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mmlw9" podStartSLOduration=252.408821239 podStartE2EDuration="4m14.501566114s" podCreationTimestamp="2026-05-21 16:37:13 +0000 UTC" firstStartedPulling="2026-05-21 16:41:24.498275895 +0000 UTC m=+283.405254831" lastFinishedPulling="2026-05-21 16:41:26.591020765 +0000 UTC m=+285.497999706" observedRunningTime="2026-05-21 16:41:27.500590394 +0000 UTC m=+286.407569365" watchObservedRunningTime="2026-05-21 16:41:27.501566114 +0000 UTC m=+286.408545071"
May 21 16:41:28.473850 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:28.473815    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:38.477600 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:38.477567    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mmlw9"
May 21 16:41:41.575308 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:41.575272    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:41:41.575820 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:41.575800    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:41:41.578323 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:41:41.578304    2559 kubelet.go:1628] "Image garbage collection succeeded"
May 21 16:43:58.606866 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.606826    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zq6n9"]
May 21 16:43:58.609835 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.609819    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.612264 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.612243    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 16:43:58.612901 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.612887    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kcvcg\""
May 21 16:43:58.612981 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.612903    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 16:43:58.616758 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.616738    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zq6n9"]
May 21 16:43:58.748634 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.748604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.748787 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.748670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw72s\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-kube-api-access-qw72s\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.849448 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.849420    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw72s\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-kube-api-access-qw72s\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.849623 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.849458    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.862624 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.862567    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.862777 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.862760    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw72s\" (UniqueName: \"kubernetes.io/projected/b5272e26-ed6d-4248-aeb3-11d71a51488e-kube-api-access-qw72s\") pod \"cert-manager-cainjector-68b757865b-zq6n9\" (UID: \"b5272e26-ed6d-4248-aeb3-11d71a51488e\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:58.918418 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:58.918394    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9"
May 21 16:43:59.035273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:59.035233    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zq6n9"]
May 21 16:43:59.037834 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:43:59.037808    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5272e26_ed6d_4248_aeb3_11d71a51488e.slice/crio-17bd3c5eee9307ede23ce98c5e9aa39977cf407b2d87ef876f43a75de0c1eabd WatchSource:0}: Error finding container 17bd3c5eee9307ede23ce98c5e9aa39977cf407b2d87ef876f43a75de0c1eabd: Status 404 returned error can't find the container with id 17bd3c5eee9307ede23ce98c5e9aa39977cf407b2d87ef876f43a75de0c1eabd
May 21 16:43:59.039637 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:59.039621    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:43:59.851661 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:43:59.851620    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9" event={"ID":"b5272e26-ed6d-4248-aeb3-11d71a51488e","Type":"ContainerStarted","Data":"17bd3c5eee9307ede23ce98c5e9aa39977cf407b2d87ef876f43a75de0c1eabd"}
May 21 16:44:02.860896 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:02.860804    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9" event={"ID":"b5272e26-ed6d-4248-aeb3-11d71a51488e","Type":"ContainerStarted","Data":"9be94f0da0a308592396f69da5dfa393fef0d65efcb895196e629d97237e2ec3"}
May 21 16:44:02.876251 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:02.876206    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-zq6n9" podStartSLOduration=1.389450562 podStartE2EDuration="4.876192915s" podCreationTimestamp="2026-05-21 16:43:58 +0000 UTC" firstStartedPulling="2026-05-21 16:43:59.039745727 +0000 UTC m=+437.946724663" lastFinishedPulling="2026-05-21 16:44:02.52648808 +0000 UTC m=+441.433467016" observedRunningTime="2026-05-21 16:44:02.874628349 +0000 UTC m=+441.781607317" watchObservedRunningTime="2026-05-21 16:44:02.876192915 +0000 UTC m=+441.783171874"
May 21 16:44:29.091458 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.091416    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"]
May 21 16:44:29.094888 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.094870    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.097251 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.097228    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 16:44:29.097366 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.097251    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 16:44:29.097366 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.097233    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 16:44:29.097366 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.097275    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 16:44:29.097530 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.097512    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rghj9\""
May 21 16:44:29.113926 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.113902    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"]
May 21 16:44:29.270877 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.270835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.271094 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.270980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntbb\" (UniqueName: \"kubernetes.io/projected/4f023576-78e3-4fda-bfaf-fb0d0017605a-kube-api-access-vntbb\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.271094 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.271023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.372182 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.372095    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vntbb\" (UniqueName: \"kubernetes.io/projected/4f023576-78e3-4fda-bfaf-fb0d0017605a-kube-api-access-vntbb\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.372182 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.372140    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.372182 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.372174    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.374707 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.374687    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.374805 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.374736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f023576-78e3-4fda-bfaf-fb0d0017605a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.379864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.379840    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntbb\" (UniqueName: \"kubernetes.io/projected/4f023576-78e3-4fda-bfaf-fb0d0017605a-kube-api-access-vntbb\") pod \"opendatahub-operator-controller-manager-86cfc76844-wrkxc\" (UID: \"4f023576-78e3-4fda-bfaf-fb0d0017605a\") " pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.404764 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.404717    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:29.535271 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.534567    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"]
May 21 16:44:29.541384 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:44:29.541345    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f023576_78e3_4fda_bfaf_fb0d0017605a.slice/crio-5ebeb8ccb768cb8041136fea6b23f6180c85c6b1bb61970edce4ca4b7fc53ac5 WatchSource:0}: Error finding container 5ebeb8ccb768cb8041136fea6b23f6180c85c6b1bb61970edce4ca4b7fc53ac5: Status 404 returned error can't find the container with id 5ebeb8ccb768cb8041136fea6b23f6180c85c6b1bb61970edce4ca4b7fc53ac5
May 21 16:44:29.931861 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:29.931825    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc" event={"ID":"4f023576-78e3-4fda-bfaf-fb0d0017605a","Type":"ContainerStarted","Data":"5ebeb8ccb768cb8041136fea6b23f6180c85c6b1bb61970edce4ca4b7fc53ac5"}
May 21 16:44:32.941606 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:32.941573    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc" event={"ID":"4f023576-78e3-4fda-bfaf-fb0d0017605a","Type":"ContainerStarted","Data":"a578b9d9a9c363588be8e9488442a49e3cffd7263b788551f63de1ec4b536186"}
May 21 16:44:32.942018 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:32.941689    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:32.961275 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:32.961204    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc" podStartSLOduration=1.252823893 podStartE2EDuration="3.961186104s" podCreationTimestamp="2026-05-21 16:44:29 +0000 UTC" firstStartedPulling="2026-05-21 16:44:29.543081222 +0000 UTC m=+468.450060158" lastFinishedPulling="2026-05-21 16:44:32.251443432 +0000 UTC m=+471.158422369" observedRunningTime="2026-05-21 16:44:32.96004665 +0000 UTC m=+471.867025609" watchObservedRunningTime="2026-05-21 16:44:32.961186104 +0000 UTC m=+471.868165054"
May 21 16:44:43.946040 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:43.946011    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86cfc76844-wrkxc"
May 21 16:44:47.699812 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.699776    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"]
May 21 16:44:47.704006 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.703971    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.706315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.706290    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 16:44:47.706315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.706307    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 16:44:47.707345 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.707323    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 16:44:47.707480 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.707356    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 16:44:47.733357 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.733298    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"]
May 21 16:44:47.806359 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.806321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95558db-c746-40bb-8d9b-655023b61bc5-tls-certs\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.806528 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.806370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95558db-c746-40bb-8d9b-655023b61bc5-tmp\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.806528 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.806398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8tc\" (UniqueName: \"kubernetes.io/projected/b95558db-c746-40bb-8d9b-655023b61bc5-kube-api-access-jh8tc\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.907100 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.907064    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95558db-c746-40bb-8d9b-655023b61bc5-tls-certs\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.907285 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.907108    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95558db-c746-40bb-8d9b-655023b61bc5-tmp\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.907285 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.907187    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8tc\" (UniqueName: \"kubernetes.io/projected/b95558db-c746-40bb-8d9b-655023b61bc5-kube-api-access-jh8tc\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.909416 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.909388    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b95558db-c746-40bb-8d9b-655023b61bc5-tmp\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.909604 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.909585    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95558db-c746-40bb-8d9b-655023b61bc5-tls-certs\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:47.924265 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:47.924230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8tc\" (UniqueName: \"kubernetes.io/projected/b95558db-c746-40bb-8d9b-655023b61bc5-kube-api-access-jh8tc\") pod \"kube-auth-proxy-59ddccfd95-rp7kk\" (UID: \"b95558db-c746-40bb-8d9b-655023b61bc5\") " pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:48.013995 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:48.013963    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"
May 21 16:44:48.146898 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:48.146872    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk"]
May 21 16:44:48.149669 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:44:48.149635    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95558db_c746_40bb_8d9b_655023b61bc5.slice/crio-22c66d03bff078e1192dc40547e75e226856afb90974443bbb8e8ef4b980497b WatchSource:0}: Error finding container 22c66d03bff078e1192dc40547e75e226856afb90974443bbb8e8ef4b980497b: Status 404 returned error can't find the container with id 22c66d03bff078e1192dc40547e75e226856afb90974443bbb8e8ef4b980497b
May 21 16:44:48.984427 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:48.984387    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk" event={"ID":"b95558db-c746-40bb-8d9b-655023b61bc5","Type":"ContainerStarted","Data":"22c66d03bff078e1192dc40547e75e226856afb90974443bbb8e8ef4b980497b"}
May 21 16:44:51.686542 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.686452    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b9hfc"]
May 21 16:44:51.689570 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.689554    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.691646 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.691622    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 16:44:51.691805 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.691622    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ppjbl\""
May 21 16:44:51.699897 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.699875    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b9hfc"]
May 21 16:44:51.737826 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.737800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.738005 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.737853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gpd\" (UniqueName: \"kubernetes.io/projected/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-kube-api-access-76gpd\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.838416 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.838374    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.838619 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.838437    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76gpd\" (UniqueName: \"kubernetes.io/projected/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-kube-api-access-76gpd\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.838619 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:51.838540    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 16:44:51.838619 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:51.838618    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert podName:0e3b1946-ebe3-4c1e-a099-eda33a6c61e5 nodeName:}" failed. No retries permitted until 2026-05-21 16:44:52.338595822 +0000 UTC m=+491.245574758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert") pod "odh-model-controller-858dbf95b8-b9hfc" (UID: "0e3b1946-ebe3-4c1e-a099-eda33a6c61e5") : secret "odh-model-controller-webhook-cert" not found
May 21 16:44:51.846888 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.846858    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gpd\" (UniqueName: \"kubernetes.io/projected/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-kube-api-access-76gpd\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:51.994298 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:51.994199    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk" event={"ID":"b95558db-c746-40bb-8d9b-655023b61bc5","Type":"ContainerStarted","Data":"bec519868040f202452b2832611f244e0a78f00a3cc119c50b34aef6eb2a25e0"}
May 21 16:44:52.010899 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:52.010849    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59ddccfd95-rp7kk" podStartSLOduration=1.809455715 podStartE2EDuration="5.010834622s" podCreationTimestamp="2026-05-21 16:44:47 +0000 UTC" firstStartedPulling="2026-05-21 16:44:48.151231061 +0000 UTC m=+487.058209997" lastFinishedPulling="2026-05-21 16:44:51.352609955 +0000 UTC m=+490.259588904" observedRunningTime="2026-05-21 16:44:52.009530809 +0000 UTC m=+490.916509766" watchObservedRunningTime="2026-05-21 16:44:52.010834622 +0000 UTC m=+490.917813579"
May 21 16:44:52.341329 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:52.341293    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:52.341493 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:52.341418    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 16:44:52.341493 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:52.341472    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert podName:0e3b1946-ebe3-4c1e-a099-eda33a6c61e5 nodeName:}" failed. No retries permitted until 2026-05-21 16:44:53.341457036 +0000 UTC m=+492.248435972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert") pod "odh-model-controller-858dbf95b8-b9hfc" (UID: "0e3b1946-ebe3-4c1e-a099-eda33a6c61e5") : secret "odh-model-controller-webhook-cert" not found
May 21 16:44:53.347330 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:53.347295    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:53.349771 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:53.349745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e3b1946-ebe3-4c1e-a099-eda33a6c61e5-cert\") pod \"odh-model-controller-858dbf95b8-b9hfc\" (UID: \"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5\") " pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:53.499711 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:53.499673    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:44:53.626007 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:53.625909    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b9hfc"]
May 21 16:44:53.628875 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:44:53.628850    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3b1946_ebe3_4c1e_a099_eda33a6c61e5.slice/crio-0ff65c624c0228528579231a0e5a5f7222b09124b88fa1a996bb98bd5c5bcd7a WatchSource:0}: Error finding container 0ff65c624c0228528579231a0e5a5f7222b09124b88fa1a996bb98bd5c5bcd7a: Status 404 returned error can't find the container with id 0ff65c624c0228528579231a0e5a5f7222b09124b88fa1a996bb98bd5c5bcd7a
May 21 16:44:54.000757 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:54.000728    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" event={"ID":"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5","Type":"ContainerStarted","Data":"0ff65c624c0228528579231a0e5a5f7222b09124b88fa1a996bb98bd5c5bcd7a"}
May 21 16:44:57.011524 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.011494    2559 generic.go:358] "Generic (PLEG): container finished" podID="0e3b1946-ebe3-4c1e-a099-eda33a6c61e5" containerID="0664edfab98090a93d3dbb165d04ef593f11b6e206c17278bc33e6029f4d3547" exitCode=1
May 21 16:44:57.011925 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.011586    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" event={"ID":"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5","Type":"ContainerDied","Data":"0664edfab98090a93d3dbb165d04ef593f11b6e206c17278bc33e6029f4d3547"}
May 21 16:44:57.011925 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.011773    2559 scope.go:117] "RemoveContainer" containerID="0664edfab98090a93d3dbb165d04ef593f11b6e206c17278bc33e6029f4d3547"
May 21 16:44:57.017808 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.017787    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-8w6qs"]
May 21 16:44:57.020745 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.020731    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.023976 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.023956    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7dmqp\""
May 21 16:44:57.024431 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.024402    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 16:44:57.039067 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.039039    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-8w6qs"]
May 21 16:44:57.077634 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.077603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.077813 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.077658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7sj2\" (UniqueName: \"kubernetes.io/projected/3112c9b0-9af1-4b20-8b9e-e67b3501b341-kube-api-access-g7sj2\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.178357 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.178319    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.178522 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.178368    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7sj2\" (UniqueName: \"kubernetes.io/projected/3112c9b0-9af1-4b20-8b9e-e67b3501b341-kube-api-access-g7sj2\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.178522 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:57.178463    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 16:44:57.178603 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:57.178525    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert podName:3112c9b0-9af1-4b20-8b9e-e67b3501b341 nodeName:}" failed. No retries permitted until 2026-05-21 16:44:57.678509717 +0000 UTC m=+496.585488657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert") pod "kserve-controller-manager-856948b99f-8w6qs" (UID: "3112c9b0-9af1-4b20-8b9e-e67b3501b341") : secret "kserve-webhook-server-cert" not found
May 21 16:44:57.190100 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.190068    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7sj2\" (UniqueName: \"kubernetes.io/projected/3112c9b0-9af1-4b20-8b9e-e67b3501b341-kube-api-access-g7sj2\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.682856 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:57.682762    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:57.683033 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:57.682904    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 16:44:57.683033 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:57.682987    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert podName:3112c9b0-9af1-4b20-8b9e-e67b3501b341 nodeName:}" failed. No retries permitted until 2026-05-21 16:44:58.682972124 +0000 UTC m=+497.589951061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert") pod "kserve-controller-manager-856948b99f-8w6qs" (UID: "3112c9b0-9af1-4b20-8b9e-e67b3501b341") : secret "kserve-webhook-server-cert" not found
May 21 16:44:58.015857 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.015822    2559 generic.go:358] "Generic (PLEG): container finished" podID="0e3b1946-ebe3-4c1e-a099-eda33a6c61e5" containerID="6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369" exitCode=1
May 21 16:44:58.016249 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.015878    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" event={"ID":"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5","Type":"ContainerDied","Data":"6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369"}
May 21 16:44:58.016249 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.015918    2559 scope.go:117] "RemoveContainer" containerID="0664edfab98090a93d3dbb165d04ef593f11b6e206c17278bc33e6029f4d3547"
May 21 16:44:58.016249 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.016138    2559 scope.go:117] "RemoveContainer" containerID="6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369"
May 21 16:44:58.016381 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:58.016335    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-b9hfc_opendatahub(0e3b1946-ebe3-4c1e-a099-eda33a6c61e5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" podUID="0e3b1946-ebe3-4c1e-a099-eda33a6c61e5"
May 21 16:44:58.691622 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.691579    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:58.694034 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.694003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3112c9b0-9af1-4b20-8b9e-e67b3501b341-cert\") pod \"kserve-controller-manager-856948b99f-8w6qs\" (UID: \"3112c9b0-9af1-4b20-8b9e-e67b3501b341\") " pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:58.830466 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.830432    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:44:58.983558 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:58.983478    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-8w6qs"]
May 21 16:44:58.986510 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:44:58.986477    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3112c9b0_9af1_4b20_8b9e_e67b3501b341.slice/crio-29d695ec2ed935e6d4641219088767e091b9fb7fe1201640926f71fd79ea4f61 WatchSource:0}: Error finding container 29d695ec2ed935e6d4641219088767e091b9fb7fe1201640926f71fd79ea4f61: Status 404 returned error can't find the container with id 29d695ec2ed935e6d4641219088767e091b9fb7fe1201640926f71fd79ea4f61
May 21 16:44:59.022948 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:59.022906    2559 scope.go:117] "RemoveContainer" containerID="6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369"
May 21 16:44:59.023346 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:44:59.023157    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-b9hfc_opendatahub(0e3b1946-ebe3-4c1e-a099-eda33a6c61e5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" podUID="0e3b1946-ebe3-4c1e-a099-eda33a6c61e5"
May 21 16:44:59.023727 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:44:59.023708    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs" event={"ID":"3112c9b0-9af1-4b20-8b9e-e67b3501b341","Type":"ContainerStarted","Data":"29d695ec2ed935e6d4641219088767e091b9fb7fe1201640926f71fd79ea4f61"}
May 21 16:45:03.036640 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.036610    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs" event={"ID":"3112c9b0-9af1-4b20-8b9e-e67b3501b341","Type":"ContainerStarted","Data":"64604e097632a73679004cf5002822ad9b3db80d94d7bc453309796715a089f8"}
May 21 16:45:03.037040 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.036691    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:45:03.067526 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.067472    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs" podStartSLOduration=2.825907655 podStartE2EDuration="6.067457051s" podCreationTimestamp="2026-05-21 16:44:57 +0000 UTC" firstStartedPulling="2026-05-21 16:44:58.987912433 +0000 UTC m=+497.894891369" lastFinishedPulling="2026-05-21 16:45:02.22946182 +0000 UTC m=+501.136440765" observedRunningTime="2026-05-21 16:45:03.066654421 +0000 UTC m=+501.973633381" watchObservedRunningTime="2026-05-21 16:45:03.067457051 +0000 UTC m=+501.974436008"
May 21 16:45:03.496860 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.496789    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"]
May 21 16:45:03.499856 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.499831    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:45:03.499966 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.499885    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.500332 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.500314    2559 scope.go:117] "RemoveContainer" containerID="6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369"
May 21 16:45:03.500490 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:45:03.500473    2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-b9hfc_opendatahub(0e3b1946-ebe3-4c1e-a099-eda33a6c61e5)\"" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" podUID="0e3b1946-ebe3-4c1e-a099-eda33a6c61e5"
May 21 16:45:03.503203 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.503187    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 16:45:03.503626 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.503610    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 16:45:03.508598 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.508576    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-whtsz\""
May 21 16:45:03.539216 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.539186    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"]
May 21 16:45:03.628598 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.628567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-operator-config\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.628789 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.628651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949jq\" (UniqueName: \"kubernetes.io/projected/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-kube-api-access-949jq\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.729841 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.729804    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-operator-config\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.730041 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.729867    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-949jq\" (UniqueName: \"kubernetes.io/projected/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-kube-api-access-949jq\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.732314 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.732290    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-operator-config\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.738907 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.738881    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949jq\" (UniqueName: \"kubernetes.io/projected/015d32ec-4bdf-4ba7-a5fb-a0d3c4768352-kube-api-access-949jq\") pod \"servicemesh-operator3-55f49c5f94-4q7j5\" (UID: \"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.809229 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.809192    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:03.949931 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:03.949909    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"]
May 21 16:45:03.952761 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:45:03.952733    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015d32ec_4bdf_4ba7_a5fb_a0d3c4768352.slice/crio-0460a59bf3b909d1dec1e558c795d99551acce764f236371a981b9f4e9ab79cd WatchSource:0}: Error finding container 0460a59bf3b909d1dec1e558c795d99551acce764f236371a981b9f4e9ab79cd: Status 404 returned error can't find the container with id 0460a59bf3b909d1dec1e558c795d99551acce764f236371a981b9f4e9ab79cd
May 21 16:45:04.041313 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:04.041273    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5" event={"ID":"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352","Type":"ContainerStarted","Data":"0460a59bf3b909d1dec1e558c795d99551acce764f236371a981b9f4e9ab79cd"}
May 21 16:45:07.054718 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:07.054684    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5" event={"ID":"015d32ec-4bdf-4ba7-a5fb-a0d3c4768352","Type":"ContainerStarted","Data":"cab55d09028afd9c99d14a7d750e5471ddc54666e8f938fb76c862ce1a1bfbaf"}
May 21 16:45:07.055135 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:07.054819    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:07.076283 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:07.076225    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5" podStartSLOduration=1.337731932 podStartE2EDuration="4.076209809s" podCreationTimestamp="2026-05-21 16:45:03 +0000 UTC" firstStartedPulling="2026-05-21 16:45:03.955307094 +0000 UTC m=+502.862286030" lastFinishedPulling="2026-05-21 16:45:06.693784971 +0000 UTC m=+505.600763907" observedRunningTime="2026-05-21 16:45:07.074967031 +0000 UTC m=+505.981945990" watchObservedRunningTime="2026-05-21 16:45:07.076209809 +0000 UTC m=+505.983188767"
May 21 16:45:13.500657 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:13.500600    2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:45:13.501160 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:13.501037    2559 scope.go:117] "RemoveContainer" containerID="6a320bfa52d71e0319a36e26510b821d82c195378b33911c866dea4bd6f17369"
May 21 16:45:14.080096 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:14.080005    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" event={"ID":"0e3b1946-ebe3-4c1e-a099-eda33a6c61e5","Type":"ContainerStarted","Data":"29d31f5a58521ab76f6714245b5982a46f76a7f6bfc3aa1cb031e1a7c9ef0e80"}
May 21 16:45:14.080263 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:14.080231    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:45:14.096460 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:14.096403    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc" podStartSLOduration=2.978070769 podStartE2EDuration="23.096388346s" podCreationTimestamp="2026-05-21 16:44:51 +0000 UTC" firstStartedPulling="2026-05-21 16:44:53.630408739 +0000 UTC m=+492.537387675" lastFinishedPulling="2026-05-21 16:45:13.748726302 +0000 UTC m=+512.655705252" observedRunningTime="2026-05-21 16:45:14.095957161 +0000 UTC m=+513.002936117" watchObservedRunningTime="2026-05-21 16:45:14.096388346 +0000 UTC m=+513.003367304"
May 21 16:45:18.060308 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:18.060273    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-4q7j5"
May 21 16:45:25.085886 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:25.085854    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-b9hfc"
May 21 16:45:34.046554 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:34.046461    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-8w6qs"
May 21 16:45:48.567210 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.567171    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:48.577239 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.577214    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:48.579634 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.579603    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 16:45:48.579748 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.579663    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 16:45:48.580177 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.580157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglrr\" (UniqueName: \"kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr\") pod \"kuadrant-operator-catalog-2d8gn\" (UID: \"40841318-ccd1-49c1-9c53-33b18e7336be\") " pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:48.580910 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.580885    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-97qm2\""
May 21 16:45:48.582476 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.582451    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:48.680521 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.680495    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nglrr\" (UniqueName: \"kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr\") pod \"kuadrant-operator-catalog-2d8gn\" (UID: \"40841318-ccd1-49c1-9c53-33b18e7336be\") " pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:48.690382 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.690363    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglrr\" (UniqueName: \"kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr\") pod \"kuadrant-operator-catalog-2d8gn\" (UID: \"40841318-ccd1-49c1-9c53-33b18e7336be\") " pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:48.886819 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.886730    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:48.929398 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:48.929365    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:49.016468 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.016440    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:49.019748 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:45:49.019702    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40841318_ccd1_49c1_9c53_33b18e7336be.slice/crio-2672dc3e49ef7888b9358d5a84017c53dde32672abb5904c02399cd43cbce855 WatchSource:0}: Error finding container 2672dc3e49ef7888b9358d5a84017c53dde32672abb5904c02399cd43cbce855: Status 404 returned error can't find the container with id 2672dc3e49ef7888b9358d5a84017c53dde32672abb5904c02399cd43cbce855
May 21 16:45:49.140360 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.140282    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hns2v"]
May 21 16:45:49.144762 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.144744    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:49.156658 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.156634    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hns2v"]
May 21 16:45:49.185896 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.185867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznlf\" (UniqueName: \"kubernetes.io/projected/0e9b0809-3102-4370-9e4c-7b90041570d8-kube-api-access-jznlf\") pod \"kuadrant-operator-catalog-hns2v\" (UID: \"0e9b0809-3102-4370-9e4c-7b90041570d8\") " pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:49.191052 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.191029    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" event={"ID":"40841318-ccd1-49c1-9c53-33b18e7336be","Type":"ContainerStarted","Data":"2672dc3e49ef7888b9358d5a84017c53dde32672abb5904c02399cd43cbce855"}
May 21 16:45:49.269164 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.269131    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"]
May 21 16:45:49.275721 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.275697    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.278586 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.278559    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 16:45:49.278912 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.278559    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 16:45:49.278912 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.278883    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p46wl\""
May 21 16:45:49.279037 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.278913    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 16:45:49.279190 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.279177    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 16:45:49.286435 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.286612 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286594    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jznlf\" (UniqueName: \"kubernetes.io/projected/0e9b0809-3102-4370-9e4c-7b90041570d8-kube-api-access-jznlf\") pod \"kuadrant-operator-catalog-hns2v\" (UID: \"0e9b0809-3102-4370-9e4c-7b90041570d8\") " pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:49.286767 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.286885 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmfb\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-kube-api-access-4kmfb\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.286885 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.287015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.287015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.286972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.287015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.287008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.288066 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.288048    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"]
May 21 16:45:49.299720 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.299699    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznlf\" (UniqueName: \"kubernetes.io/projected/0e9b0809-3102-4370-9e4c-7b90041570d8-kube-api-access-jznlf\") pod \"kuadrant-operator-catalog-hns2v\" (UID: \"0e9b0809-3102-4370-9e4c-7b90041570d8\") " pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:49.387613 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387578    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387613 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387623    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmfb\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-kube-api-access-4kmfb\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387642    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387676    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387700    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387715    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.387867 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.387778    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.388438 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.388408    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.390039 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.390015    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.390147 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.390132    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.390191 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.390174    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.390230 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.390219    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.396808 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.396756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmfb\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-kube-api-access-4kmfb\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.396808 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.396775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aa3b584-7f1d-45d4-92c8-72ccaa1e0283-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5gpcb\" (UID: \"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.455458 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.455427    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:49.582694 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.582581    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hns2v"]
May 21 16:45:49.584689 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.584663    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:49.585715 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:45:49.585686    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9b0809_3102_4370_9e4c_7b90041570d8.slice/crio-f6526fdb69a93f7047d0f76d0723802df8ea6eb33b87e9036aa7934ada9aa431 WatchSource:0}: Error finding container f6526fdb69a93f7047d0f76d0723802df8ea6eb33b87e9036aa7934ada9aa431: Status 404 returned error can't find the container with id f6526fdb69a93f7047d0f76d0723802df8ea6eb33b87e9036aa7934ada9aa431
May 21 16:45:49.732521 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:49.732430    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"]
May 21 16:45:49.734632 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:45:49.734600    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa3b584_7f1d_45d4_92c8_72ccaa1e0283.slice/crio-f1ca0d4287789f5192c11928e772c436037d2647e41f07e6ec1850249607df9a WatchSource:0}: Error finding container f1ca0d4287789f5192c11928e772c436037d2647e41f07e6ec1850249607df9a: Status 404 returned error can't find the container with id f1ca0d4287789f5192c11928e772c436037d2647e41f07e6ec1850249607df9a
May 21 16:45:50.197254 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:50.197216    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb" event={"ID":"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283","Type":"ContainerStarted","Data":"f1ca0d4287789f5192c11928e772c436037d2647e41f07e6ec1850249607df9a"}
May 21 16:45:50.198633 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:50.198602    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hns2v" event={"ID":"0e9b0809-3102-4370-9e4c-7b90041570d8","Type":"ContainerStarted","Data":"f6526fdb69a93f7047d0f76d0723802df8ea6eb33b87e9036aa7934ada9aa431"}
May 21 16:45:52.206854 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:52.206815    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" event={"ID":"40841318-ccd1-49c1-9c53-33b18e7336be","Type":"ContainerStarted","Data":"690e1222aeec30c4807afbc1551658020f466200540db8a367da29f89ea36732"}
May 21 16:45:52.207334 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:52.206843    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" podUID="40841318-ccd1-49c1-9c53-33b18e7336be" containerName="registry-server" containerID="cri-o://690e1222aeec30c4807afbc1551658020f466200540db8a367da29f89ea36732" gracePeriod=2
May 21 16:45:52.208820 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:52.208789    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hns2v" event={"ID":"0e9b0809-3102-4370-9e4c-7b90041570d8","Type":"ContainerStarted","Data":"22eff4d4c44a41d7f79d0abe589335d271ba9613f35d874ae1558f503392eb8a"}
May 21 16:45:52.224686 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:52.224645    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" podStartSLOduration=2.002758324 podStartE2EDuration="4.2246323s" podCreationTimestamp="2026-05-21 16:45:48 +0000 UTC" firstStartedPulling="2026-05-21 16:45:49.02127383 +0000 UTC m=+547.928252766" lastFinishedPulling="2026-05-21 16:45:51.243147805 +0000 UTC m=+550.150126742" observedRunningTime="2026-05-21 16:45:52.223405749 +0000 UTC m=+551.130384708" watchObservedRunningTime="2026-05-21 16:45:52.2246323 +0000 UTC m=+551.131611257"
May 21 16:45:52.243571 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:52.243478    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hns2v" podStartSLOduration=1.5616364630000001 podStartE2EDuration="3.243147256s" podCreationTimestamp="2026-05-21 16:45:49 +0000 UTC" firstStartedPulling="2026-05-21 16:45:49.58713782 +0000 UTC m=+548.494116755" lastFinishedPulling="2026-05-21 16:45:51.268648612 +0000 UTC m=+550.175627548" observedRunningTime="2026-05-21 16:45:52.242994839 +0000 UTC m=+551.149973798" watchObservedRunningTime="2026-05-21 16:45:52.243147256 +0000 UTC m=+551.150126214"
May 21 16:45:53.174848 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.174667    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 16:45:53.174848 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.174760    2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
May 21 16:45:53.213648 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.213618    2559 generic.go:358] "Generic (PLEG): container finished" podID="40841318-ccd1-49c1-9c53-33b18e7336be" containerID="690e1222aeec30c4807afbc1551658020f466200540db8a367da29f89ea36732" exitCode=0
May 21 16:45:53.214007 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.213689    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" event={"ID":"40841318-ccd1-49c1-9c53-33b18e7336be","Type":"ContainerDied","Data":"690e1222aeec30c4807afbc1551658020f466200540db8a367da29f89ea36732"}
May 21 16:45:53.255028 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.255007    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:53.313814 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.313789    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nglrr\" (UniqueName: \"kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr\") pod \"40841318-ccd1-49c1-9c53-33b18e7336be\" (UID: \"40841318-ccd1-49c1-9c53-33b18e7336be\") "
May 21 16:45:53.316005 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.315968    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr" (OuterVolumeSpecName: "kube-api-access-nglrr") pod "40841318-ccd1-49c1-9c53-33b18e7336be" (UID: "40841318-ccd1-49c1-9c53-33b18e7336be"). InnerVolumeSpecName "kube-api-access-nglrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:45:53.415283 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:53.415210    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nglrr\" (UniqueName: \"kubernetes.io/projected/40841318-ccd1-49c1-9c53-33b18e7336be-kube-api-access-nglrr\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:45:54.218441 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.218389    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb" event={"ID":"8aa3b584-7f1d-45d4-92c8-72ccaa1e0283","Type":"ContainerStarted","Data":"e52fd018b07cd1ca6595151796715a84109da0d99cb302b1d4ed1c1dda3bcd81"}
May 21 16:45:54.218901 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.218777    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:54.219979 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.219922    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn" event={"ID":"40841318-ccd1-49c1-9c53-33b18e7336be","Type":"ContainerDied","Data":"2672dc3e49ef7888b9358d5a84017c53dde32672abb5904c02399cd43cbce855"}
May 21 16:45:54.219979 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.219967    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2d8gn"
May 21 16:45:54.220163 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.219992    2559 scope.go:117] "RemoveContainer" containerID="690e1222aeec30c4807afbc1551658020f466200540db8a367da29f89ea36732"
May 21 16:45:54.220163 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.220116    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-5gpcb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 16:45:54.220276 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.220193    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb" podUID="8aa3b584-7f1d-45d4-92c8-72ccaa1e0283" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:45:54.244148 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.244102    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb" podStartSLOduration=1.806347895 podStartE2EDuration="5.244089048s" podCreationTimestamp="2026-05-21 16:45:49 +0000 UTC" firstStartedPulling="2026-05-21 16:45:49.736639533 +0000 UTC m=+548.643618475" lastFinishedPulling="2026-05-21 16:45:53.174380685 +0000 UTC m=+552.081359628" observedRunningTime="2026-05-21 16:45:54.242257219 +0000 UTC m=+553.149236176" watchObservedRunningTime="2026-05-21 16:45:54.244089048 +0000 UTC m=+553.151068005"
May 21 16:45:54.266552 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.266523    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:54.275026 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:54.275003    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2d8gn"]
May 21 16:45:55.225018 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:55.224987    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5gpcb"
May 21 16:45:55.706677 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:55.706646    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40841318-ccd1-49c1-9c53-33b18e7336be" path="/var/lib/kubelet/pods/40841318-ccd1-49c1-9c53-33b18e7336be/volumes"
May 21 16:45:59.456342 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:59.456311    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:59.456725 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:59.456385    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:45:59.477646 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:45:59.477626    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:46:00.259703 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:00.259677    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hns2v"
May 21 16:46:25.555857 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.555819    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6zgxz"]
May 21 16:46:25.556412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.556142    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40841318-ccd1-49c1-9c53-33b18e7336be" containerName="registry-server"
May 21 16:46:25.556412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.556155    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40841318-ccd1-49c1-9c53-33b18e7336be" containerName="registry-server"
May 21 16:46:25.556412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.556274    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="40841318-ccd1-49c1-9c53-33b18e7336be" containerName="registry-server"
May 21 16:46:25.640118 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.640086    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6zgxz"]
May 21 16:46:25.640320 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.640232    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:25.642625 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.642606    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4slwt\""
May 21 16:46:25.790068 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.790024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smg6v\" (UniqueName: \"kubernetes.io/projected/a2ac4434-21dd-4a58-b7c8-0357bb079fa9-kube-api-access-smg6v\") pod \"authorino-operator-657f44b778-6zgxz\" (UID: \"a2ac4434-21dd-4a58-b7c8-0357bb079fa9\") " pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:25.891005 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.890908    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smg6v\" (UniqueName: \"kubernetes.io/projected/a2ac4434-21dd-4a58-b7c8-0357bb079fa9-kube-api-access-smg6v\") pod \"authorino-operator-657f44b778-6zgxz\" (UID: \"a2ac4434-21dd-4a58-b7c8-0357bb079fa9\") " pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:25.904718 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.904698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smg6v\" (UniqueName: \"kubernetes.io/projected/a2ac4434-21dd-4a58-b7c8-0357bb079fa9-kube-api-access-smg6v\") pod \"authorino-operator-657f44b778-6zgxz\" (UID: \"a2ac4434-21dd-4a58-b7c8-0357bb079fa9\") " pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:25.950187 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:25.950158    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:26.099817 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:26.099790    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6zgxz"]
May 21 16:46:26.102480 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:46:26.102453    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ac4434_21dd_4a58_b7c8_0357bb079fa9.slice/crio-494f5815984f1e6786e34045da822c27b1a9dbc4ae4876d136241e775da420f0 WatchSource:0}: Error finding container 494f5815984f1e6786e34045da822c27b1a9dbc4ae4876d136241e775da420f0: Status 404 returned error can't find the container with id 494f5815984f1e6786e34045da822c27b1a9dbc4ae4876d136241e775da420f0
May 21 16:46:26.319695 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:26.319662    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz" event={"ID":"a2ac4434-21dd-4a58-b7c8-0357bb079fa9","Type":"ContainerStarted","Data":"494f5815984f1e6786e34045da822c27b1a9dbc4ae4876d136241e775da420f0"}
May 21 16:46:28.327005 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:28.326963    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz" event={"ID":"a2ac4434-21dd-4a58-b7c8-0357bb079fa9","Type":"ContainerStarted","Data":"a7ba58eadd68d58e53902805df4223fba758a8033c1f07feff1f599f67853788"}
May 21 16:46:28.327468 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:28.327063    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:28.343161 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:28.343116    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz" podStartSLOduration=1.5569431 podStartE2EDuration="3.343102162s" podCreationTimestamp="2026-05-21 16:46:25 +0000 UTC" firstStartedPulling="2026-05-21 16:46:26.104828345 +0000 UTC m=+585.011807282" lastFinishedPulling="2026-05-21 16:46:27.890987408 +0000 UTC m=+586.797966344" observedRunningTime="2026-05-21 16:46:28.342575024 +0000 UTC m=+587.249553985" watchObservedRunningTime="2026-05-21 16:46:28.343102162 +0000 UTC m=+587.250081120"
May 21 16:46:33.901604 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:33.901570    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"]
May 21 16:46:33.904729 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:33.904709    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:33.907026 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:33.907008    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 16:46:33.907137 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:33.907062    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9d9z7\""
May 21 16:46:33.916147 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:33.916126    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"]
May 21 16:46:34.057737 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:34.057701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkkm5\" (UniqueName: \"kubernetes.io/projected/245ff4f4-8ddc-47de-9e61-d224b1dea820-kube-api-access-jkkm5\") pod \"dns-operator-controller-manager-648d5c98bc-dh5l8\" (UID: \"245ff4f4-8ddc-47de-9e61-d224b1dea820\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:34.158999 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:34.158884    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkkm5\" (UniqueName: \"kubernetes.io/projected/245ff4f4-8ddc-47de-9e61-d224b1dea820-kube-api-access-jkkm5\") pod \"dns-operator-controller-manager-648d5c98bc-dh5l8\" (UID: \"245ff4f4-8ddc-47de-9e61-d224b1dea820\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:34.171148 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:34.171117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkkm5\" (UniqueName: \"kubernetes.io/projected/245ff4f4-8ddc-47de-9e61-d224b1dea820-kube-api-access-jkkm5\") pod \"dns-operator-controller-manager-648d5c98bc-dh5l8\" (UID: \"245ff4f4-8ddc-47de-9e61-d224b1dea820\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:34.214060 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:34.214029    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:34.341301 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:34.341276    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"]
May 21 16:46:34.343878 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:46:34.343855    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245ff4f4_8ddc_47de_9e61_d224b1dea820.slice/crio-61dac2dfbd13470a85ef1f19d8e97cac7393431637dfb084f97420e09255e516 WatchSource:0}: Error finding container 61dac2dfbd13470a85ef1f19d8e97cac7393431637dfb084f97420e09255e516: Status 404 returned error can't find the container with id 61dac2dfbd13470a85ef1f19d8e97cac7393431637dfb084f97420e09255e516
May 21 16:46:35.348082 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:35.348048    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8" event={"ID":"245ff4f4-8ddc-47de-9e61-d224b1dea820","Type":"ContainerStarted","Data":"61dac2dfbd13470a85ef1f19d8e97cac7393431637dfb084f97420e09255e516"}
May 21 16:46:37.355169 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:37.355130    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8" event={"ID":"245ff4f4-8ddc-47de-9e61-d224b1dea820","Type":"ContainerStarted","Data":"8e02e4b63d0c77e5ad1e0df3c618d50c4268d17604b4ef83241088c2562967ca"}
May 21 16:46:37.355552 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:37.355304    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:37.372233 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:37.372183    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8" podStartSLOduration=1.802408131 podStartE2EDuration="4.372166674s" podCreationTimestamp="2026-05-21 16:46:33 +0000 UTC" firstStartedPulling="2026-05-21 16:46:34.345801277 +0000 UTC m=+593.252780213" lastFinishedPulling="2026-05-21 16:46:36.91555981 +0000 UTC m=+595.822538756" observedRunningTime="2026-05-21 16:46:37.371020347 +0000 UTC m=+596.277999305" watchObservedRunningTime="2026-05-21 16:46:37.372166674 +0000 UTC m=+596.279145634"
May 21 16:46:39.332456 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:39.332427    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-6zgxz"
May 21 16:46:41.596789 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:41.596763    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:46:41.597445 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:41.597426    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:46:48.361143 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:48.361115    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dh5l8"
May 21 16:46:50.427863 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.427832    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"]
May 21 16:46:50.432143 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.432123    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:50.436148 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.436131    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mvcbg\""
May 21 16:46:50.445315 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.445296    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"]
May 21 16:46:50.482840 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.482811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b4dk\" (UniqueName: \"kubernetes.io/projected/cc24254b-b262-4309-b305-4096008adbf6-kube-api-access-7b4dk\") pod \"limitador-operator-controller-manager-85c4996f8c-zr7f4\" (UID: \"cc24254b-b262-4309-b305-4096008adbf6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:50.583215 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.583185    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b4dk\" (UniqueName: \"kubernetes.io/projected/cc24254b-b262-4309-b305-4096008adbf6-kube-api-access-7b4dk\") pod \"limitador-operator-controller-manager-85c4996f8c-zr7f4\" (UID: \"cc24254b-b262-4309-b305-4096008adbf6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:50.594162 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.594134    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b4dk\" (UniqueName: \"kubernetes.io/projected/cc24254b-b262-4309-b305-4096008adbf6-kube-api-access-7b4dk\") pod \"limitador-operator-controller-manager-85c4996f8c-zr7f4\" (UID: \"cc24254b-b262-4309-b305-4096008adbf6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:50.744448 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.744361    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:50.872916 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:50.872895    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"]
May 21 16:46:50.874655 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:46:50.874620    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc24254b_b262_4309_b305_4096008adbf6.slice/crio-d1905a21ad0007ec6e1a0c83260d03ab3eb4a2f4615bd29448bc789e0352617b WatchSource:0}: Error finding container d1905a21ad0007ec6e1a0c83260d03ab3eb4a2f4615bd29448bc789e0352617b: Status 404 returned error can't find the container with id d1905a21ad0007ec6e1a0c83260d03ab3eb4a2f4615bd29448bc789e0352617b
May 21 16:46:51.399412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:51.399372    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4" event={"ID":"cc24254b-b262-4309-b305-4096008adbf6","Type":"ContainerStarted","Data":"d1905a21ad0007ec6e1a0c83260d03ab3eb4a2f4615bd29448bc789e0352617b"}
May 21 16:46:53.407223 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:53.407187    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4" event={"ID":"cc24254b-b262-4309-b305-4096008adbf6","Type":"ContainerStarted","Data":"e73614d435a362cea08f836fff46609b1b54926f42418848f8db0b5dc801594c"}
May 21 16:46:53.407696 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:53.407339    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:46:53.427331 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:46:53.427286    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4" podStartSLOduration=1.941395908 podStartE2EDuration="3.427273568s" podCreationTimestamp="2026-05-21 16:46:50 +0000 UTC" firstStartedPulling="2026-05-21 16:46:50.876729745 +0000 UTC m=+609.783708681" lastFinishedPulling="2026-05-21 16:46:52.362607389 +0000 UTC m=+611.269586341" observedRunningTime="2026-05-21 16:46:53.426382752 +0000 UTC m=+612.333361711" watchObservedRunningTime="2026-05-21 16:46:53.427273568 +0000 UTC m=+612.334252526"
May 21 16:47:04.413358 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:47:04.413284    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr7f4"
May 21 16:48:34.393881 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.393789    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:48:34.396930 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.396914    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:48:34.399412 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.399374    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 21 16:48:34.399544 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.399471    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 21 16:48:34.399603 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.399553    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k827r\""
May 21 16:48:34.400121 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.400107    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 21 16:48:34.406444 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.406426    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:48:34.520718 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.520683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jprfs\" (UniqueName: \"kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs\") pod \"maas-keycloak-0\" (UID: \"9b5b59be-c928-421b-89de-66891547932a\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:48:34.621136 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.621096    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jprfs\" (UniqueName: \"kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs\") pod \"maas-keycloak-0\" (UID: \"9b5b59be-c928-421b-89de-66891547932a\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:48:34.631539 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.631510    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jprfs\" (UniqueName: \"kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs\") pod \"maas-keycloak-0\" (UID: \"9b5b59be-c928-421b-89de-66891547932a\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:48:34.707096 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.707012    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:48:34.835054 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:34.834965    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:48:34.838126 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:48:34.838097    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5b59be_c928_421b_89de_66891547932a.slice/crio-058fb6a0c8ec84b2e0e1fcee3be63336a8892645f8add231513918219ded1844 WatchSource:0}: Error finding container 058fb6a0c8ec84b2e0e1fcee3be63336a8892645f8add231513918219ded1844: Status 404 returned error can't find the container with id 058fb6a0c8ec84b2e0e1fcee3be63336a8892645f8add231513918219ded1844
May 21 16:48:35.735007 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:35.734968    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b5b59be-c928-421b-89de-66891547932a","Type":"ContainerStarted","Data":"058fb6a0c8ec84b2e0e1fcee3be63336a8892645f8add231513918219ded1844"}
May 21 16:48:39.752196 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:39.752155    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b5b59be-c928-421b-89de-66891547932a","Type":"ContainerStarted","Data":"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"}
May 21 16:48:39.777696 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:39.777637    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.071541823 podStartE2EDuration="5.777619099s" podCreationTimestamp="2026-05-21 16:48:34 +0000 UTC" firstStartedPulling="2026-05-21 16:48:34.839329117 +0000 UTC m=+713.746308053" lastFinishedPulling="2026-05-21 16:48:39.545406388 +0000 UTC m=+718.452385329" observedRunningTime="2026-05-21 16:48:39.775196862 +0000 UTC m=+718.682175821" watchObservedRunningTime="2026-05-21 16:48:39.777619099 +0000 UTC m=+718.684598057"
May 21 16:48:40.707972 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:40.707904    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 21 16:48:40.709528 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:40.709493    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:41.707473 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:41.707422    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:42.708035 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:42.707980    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:43.707542 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:43.707491    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:44.707987 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:44.707927    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 21 16:48:44.709076 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:44.708608    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:45.708012 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:45.707966    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:46.708075 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:46.708026    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:47.707960 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:47.707885    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:48.708475 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:48.708428    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:49.708780 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:49.708647    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:50.708484 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:50.708436    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:51.707885 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:51.707846    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:52.708015 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:52.707962    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused"
May 21 16:48:53.832409 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:53.832367    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 21 16:48:53.851325 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:48:53.850751    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:49:03.839144 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:03.839113    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 21 16:49:09.349627 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.349586    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:09.352918 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.352896    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:09.355243 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.355217    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h7qxw\""
May 21 16:49:09.355351 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.355318    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 16:49:09.361404 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.361379    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:09.436178 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.436144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxdjb\" (UniqueName: \"kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb\") pod \"maas-controller-ff8fbcd8b-znr69\" (UID: \"69ebdd64-b501-45df-b437-77c31a5c9e35\") " pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:09.501174 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.501140    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:09.504433 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.504416    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:09.513859 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.513832    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:09.537306 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.537272    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxdjb\" (UniqueName: \"kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb\") pod \"maas-controller-ff8fbcd8b-znr69\" (UID: \"69ebdd64-b501-45df-b437-77c31a5c9e35\") " pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:09.551786 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.551754    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxdjb\" (UniqueName: \"kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb\") pod \"maas-controller-ff8fbcd8b-znr69\" (UID: \"69ebdd64-b501-45df-b437-77c31a5c9e35\") " pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:09.637786 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.637678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zggq\" (UniqueName: \"kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq\") pod \"maas-controller-798f474986-j86k4\" (UID: \"958ce634-4766-4bb1-85d0-f98b3213ffad\") " pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:09.663634 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.663598    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:09.738575 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.738533    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zggq\" (UniqueName: \"kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq\") pod \"maas-controller-798f474986-j86k4\" (UID: \"958ce634-4766-4bb1-85d0-f98b3213ffad\") " pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:09.747585 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.747537    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zggq\" (UniqueName: \"kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq\") pod \"maas-controller-798f474986-j86k4\" (UID: \"958ce634-4766-4bb1-85d0-f98b3213ffad\") " pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:09.802468 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.802434    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:09.805783 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:49:09.805755    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ebdd64_b501_45df_b437_77c31a5c9e35.slice/crio-20d401bf1c7061f7ae5387b96064b7150b48cd937c75798b4bed9d1cb66f175f WatchSource:0}: Error finding container 20d401bf1c7061f7ae5387b96064b7150b48cd937c75798b4bed9d1cb66f175f: Status 404 returned error can't find the container with id 20d401bf1c7061f7ae5387b96064b7150b48cd937c75798b4bed9d1cb66f175f
May 21 16:49:09.807236 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.807215    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:49:09.814890 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.814868    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:09.869599 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.869562    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" event={"ID":"69ebdd64-b501-45df-b437-77c31a5c9e35","Type":"ContainerStarted","Data":"20d401bf1c7061f7ae5387b96064b7150b48cd937c75798b4bed9d1cb66f175f"}
May 21 16:49:09.964261 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:09.964223    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:09.967290 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:49:09.967261    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958ce634_4766_4bb1_85d0_f98b3213ffad.slice/crio-bf497aba9e9b5e8bdd5a5d75a45c8e92077a8112a901965930353d4f3a636ac6 WatchSource:0}: Error finding container bf497aba9e9b5e8bdd5a5d75a45c8e92077a8112a901965930353d4f3a636ac6: Status 404 returned error can't find the container with id bf497aba9e9b5e8bdd5a5d75a45c8e92077a8112a901965930353d4f3a636ac6
May 21 16:49:10.875172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:10.875137    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798f474986-j86k4" event={"ID":"958ce634-4766-4bb1-85d0-f98b3213ffad","Type":"ContainerStarted","Data":"bf497aba9e9b5e8bdd5a5d75a45c8e92077a8112a901965930353d4f3a636ac6"}
May 21 16:49:12.884212 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.884174    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798f474986-j86k4" event={"ID":"958ce634-4766-4bb1-85d0-f98b3213ffad","Type":"ContainerStarted","Data":"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"}
May 21 16:49:12.884660 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.884366    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:12.885420 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.885400    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" event={"ID":"69ebdd64-b501-45df-b437-77c31a5c9e35","Type":"ContainerStarted","Data":"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"}
May 21 16:49:12.885586 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.885570    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:12.901639 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.901592    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-798f474986-j86k4" podStartSLOduration=1.408058908 podStartE2EDuration="3.901576118s" podCreationTimestamp="2026-05-21 16:49:09 +0000 UTC" firstStartedPulling="2026-05-21 16:49:09.968735589 +0000 UTC m=+748.875714524" lastFinishedPulling="2026-05-21 16:49:12.462252798 +0000 UTC m=+751.369231734" observedRunningTime="2026-05-21 16:49:12.900356076 +0000 UTC m=+751.807335035" watchObservedRunningTime="2026-05-21 16:49:12.901576118 +0000 UTC m=+751.808555075"
May 21 16:49:12.918419 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:12.918366    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" podStartSLOduration=1.273715461 podStartE2EDuration="3.91835147s" podCreationTimestamp="2026-05-21 16:49:09 +0000 UTC" firstStartedPulling="2026-05-21 16:49:09.80739929 +0000 UTC m=+748.714378227" lastFinishedPulling="2026-05-21 16:49:12.4520353 +0000 UTC m=+751.359014236" observedRunningTime="2026-05-21 16:49:12.91739041 +0000 UTC m=+751.824369372" watchObservedRunningTime="2026-05-21 16:49:12.91835147 +0000 UTC m=+751.825330428"
May 21 16:49:23.894072 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:23.894036    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:23.894507 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:23.894240    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:23.947109 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:23.947082    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:23.947278 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:23.947259    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" podUID="69ebdd64-b501-45df-b437-77c31a5c9e35" containerName="manager" containerID="cri-o://9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b" gracePeriod=30
May 21 16:49:24.124928 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.124894    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:49:24.128760 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.128740    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.138212 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.138186    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:49:24.185693 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.185670    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:24.264192 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.264156    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxdjb\" (UniqueName: \"kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb\") pod \"69ebdd64-b501-45df-b437-77c31a5c9e35\" (UID: \"69ebdd64-b501-45df-b437-77c31a5c9e35\") "
May 21 16:49:24.264381 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.264310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg8p2\" (UniqueName: \"kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2\") pod \"maas-controller-56c8bd6554-4jjzs\" (UID: \"551f7c94-4da2-4f13-b88c-817fc7854140\") " pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.266426 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.266401    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb" (OuterVolumeSpecName: "kube-api-access-hxdjb") pod "69ebdd64-b501-45df-b437-77c31a5c9e35" (UID: "69ebdd64-b501-45df-b437-77c31a5c9e35"). InnerVolumeSpecName "kube-api-access-hxdjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:49:24.365539 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.365503    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg8p2\" (UniqueName: \"kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2\") pod \"maas-controller-56c8bd6554-4jjzs\" (UID: \"551f7c94-4da2-4f13-b88c-817fc7854140\") " pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.365711 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.365576    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxdjb\" (UniqueName: \"kubernetes.io/projected/69ebdd64-b501-45df-b437-77c31a5c9e35-kube-api-access-hxdjb\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:49:24.374030 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.374000    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg8p2\" (UniqueName: \"kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2\") pod \"maas-controller-56c8bd6554-4jjzs\" (UID: \"551f7c94-4da2-4f13-b88c-817fc7854140\") " pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.441745 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.441656    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.569299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.569272    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:49:24.571833 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:49:24.571803    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551f7c94_4da2_4f13_b88c_817fc7854140.slice/crio-9dd746a239d51f0ebd50d25ae6b915606771c7d7dba0c07b64c40c60a0b58e25 WatchSource:0}: Error finding container 9dd746a239d51f0ebd50d25ae6b915606771c7d7dba0c07b64c40c60a0b58e25: Status 404 returned error can't find the container with id 9dd746a239d51f0ebd50d25ae6b915606771c7d7dba0c07b64c40c60a0b58e25
May 21 16:49:24.923391 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.923357    2559 generic.go:358] "Generic (PLEG): container finished" podID="69ebdd64-b501-45df-b437-77c31a5c9e35" containerID="9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b" exitCode=0
May 21 16:49:24.923882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.923436    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" event={"ID":"69ebdd64-b501-45df-b437-77c31a5c9e35","Type":"ContainerDied","Data":"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"}
May 21 16:49:24.923882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.923455    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff8fbcd8b-znr69"
May 21 16:49:24.923882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.923472    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff8fbcd8b-znr69" event={"ID":"69ebdd64-b501-45df-b437-77c31a5c9e35","Type":"ContainerDied","Data":"20d401bf1c7061f7ae5387b96064b7150b48cd937c75798b4bed9d1cb66f175f"}
May 21 16:49:24.923882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.923495    2559 scope.go:117] "RemoveContainer" containerID="9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"
May 21 16:49:24.924844 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.924804    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" event={"ID":"551f7c94-4da2-4f13-b88c-817fc7854140","Type":"ContainerStarted","Data":"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"}
May 21 16:49:24.924844 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.924839    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" event={"ID":"551f7c94-4da2-4f13-b88c-817fc7854140","Type":"ContainerStarted","Data":"9dd746a239d51f0ebd50d25ae6b915606771c7d7dba0c07b64c40c60a0b58e25"}
May 21 16:49:24.925056 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.924987    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:24.931405 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.931377    2559 scope.go:117] "RemoveContainer" containerID="9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"
May 21 16:49:24.931698 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:49:24.931652    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b\": container with ID starting with 9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b not found: ID does not exist" containerID="9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"
May 21 16:49:24.931776 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.931697    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b"} err="failed to get container status \"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b\": rpc error: code = NotFound desc = could not find container \"9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b\": container with ID starting with 9ccaf6b01e5a5efe34e4c8247fda334b9ccac7c119a4a931600df92011b4550b not found: ID does not exist"
May 21 16:49:24.944401 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.944351    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" podStartSLOduration=0.682072396 podStartE2EDuration="944.336446ms" podCreationTimestamp="2026-05-21 16:49:24 +0000 UTC" firstStartedPulling="2026-05-21 16:49:24.573119604 +0000 UTC m=+763.480098540" lastFinishedPulling="2026-05-21 16:49:24.835383654 +0000 UTC m=+763.742362590" observedRunningTime="2026-05-21 16:49:24.941857864 +0000 UTC m=+763.848836818" watchObservedRunningTime="2026-05-21 16:49:24.944336446 +0000 UTC m=+763.851315404"
May 21 16:49:24.955018 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.954992    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:24.959273 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:24.959248    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ff8fbcd8b-znr69"]
May 21 16:49:25.708142 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:25.708107    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ebdd64-b501-45df-b437-77c31a5c9e35" path="/var/lib/kubelet/pods/69ebdd64-b501-45df-b437-77c31a5c9e35/volumes"
May 21 16:49:35.935874 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:35.935842    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:49:35.981424 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:35.981393    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:35.981693 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:35.981671    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-798f474986-j86k4" podUID="958ce634-4766-4bb1-85d0-f98b3213ffad" containerName="manager" containerID="cri-o://03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33" gracePeriod=30
May 21 16:49:36.221568 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.221547    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:36.360450 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.360412    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zggq\" (UniqueName: \"kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq\") pod \"958ce634-4766-4bb1-85d0-f98b3213ffad\" (UID: \"958ce634-4766-4bb1-85d0-f98b3213ffad\") "
May 21 16:49:36.362407 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.362375    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq" (OuterVolumeSpecName: "kube-api-access-4zggq") pod "958ce634-4766-4bb1-85d0-f98b3213ffad" (UID: "958ce634-4766-4bb1-85d0-f98b3213ffad"). InnerVolumeSpecName "kube-api-access-4zggq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:49:36.460933 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.460848    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zggq\" (UniqueName: \"kubernetes.io/projected/958ce634-4766-4bb1-85d0-f98b3213ffad-kube-api-access-4zggq\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:49:36.966890 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.966852    2559 generic.go:358] "Generic (PLEG): container finished" podID="958ce634-4766-4bb1-85d0-f98b3213ffad" containerID="03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33" exitCode=0
May 21 16:49:36.967324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.966950    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798f474986-j86k4" event={"ID":"958ce634-4766-4bb1-85d0-f98b3213ffad","Type":"ContainerDied","Data":"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"}
May 21 16:49:36.967324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.966986    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-798f474986-j86k4" event={"ID":"958ce634-4766-4bb1-85d0-f98b3213ffad","Type":"ContainerDied","Data":"bf497aba9e9b5e8bdd5a5d75a45c8e92077a8112a901965930353d4f3a636ac6"}
May 21 16:49:36.967324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.967001    2559 scope.go:117] "RemoveContainer" containerID="03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"
May 21 16:49:36.967324 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.966957    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-798f474986-j86k4"
May 21 16:49:36.974895 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.974879    2559 scope.go:117] "RemoveContainer" containerID="03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"
May 21 16:49:36.975176 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:49:36.975153    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33\": container with ID starting with 03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33 not found: ID does not exist" containerID="03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"
May 21 16:49:36.975251 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.975195    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33"} err="failed to get container status \"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33\": rpc error: code = NotFound desc = could not find container \"03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33\": container with ID starting with 03198d941aab79c663a8ddbf36d3269fdac5f429edb3a1735672101703333f33 not found: ID does not exist"
May 21 16:49:36.988481 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.988461    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:36.992244 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:36.992223    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-798f474986-j86k4"]
May 21 16:49:37.706752 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:37.706720    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="958ce634-4766-4bb1-85d0-f98b3213ffad" path="/var/lib/kubelet/pods/958ce634-4766-4bb1-85d0-f98b3213ffad/volumes"
May 21 16:49:52.881467 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881432    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"]
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881737    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958ce634-4766-4bb1-85d0-f98b3213ffad" containerName="manager"
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="958ce634-4766-4bb1-85d0-f98b3213ffad" containerName="manager"
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881763    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ebdd64-b501-45df-b437-77c31a5c9e35" containerName="manager"
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881769    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ebdd64-b501-45df-b437-77c31a5c9e35" containerName="manager"
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881824    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="69ebdd64-b501-45df-b437-77c31a5c9e35" containerName="manager"
May 21 16:49:52.881962 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.881833    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="958ce634-4766-4bb1-85d0-f98b3213ffad" containerName="manager"
May 21 16:49:52.886433 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.886414    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:52.888997 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.888975    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2jvgl\""
May 21 16:49:52.889196 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.889180    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 16:49:52.895983 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.895956    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"]
May 21 16:49:52.978831 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:52.978795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9sg\" (UniqueName: \"kubernetes.io/projected/afd68f93-6a88-48c7-b9e1-3572632287e6-kube-api-access-9h9sg\") pod \"payload-processing-58b6c8fdc7-dc2fh\" (UID: \"afd68f93-6a88-48c7-b9e1-3572632287e6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:53.079574 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:53.079540    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9sg\" (UniqueName: \"kubernetes.io/projected/afd68f93-6a88-48c7-b9e1-3572632287e6-kube-api-access-9h9sg\") pod \"payload-processing-58b6c8fdc7-dc2fh\" (UID: \"afd68f93-6a88-48c7-b9e1-3572632287e6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:53.089782 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:53.089744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9sg\" (UniqueName: \"kubernetes.io/projected/afd68f93-6a88-48c7-b9e1-3572632287e6-kube-api-access-9h9sg\") pod \"payload-processing-58b6c8fdc7-dc2fh\" (UID: \"afd68f93-6a88-48c7-b9e1-3572632287e6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:53.198114 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:53.198022    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:53.330004 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:53.329971    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"]
May 21 16:49:53.333186 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:49:53.333160    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd68f93_6a88_48c7_b9e1_3572632287e6.slice/crio-403a9fa9eb1b038f5a55aa99c720f6c46e0d12c2cfbe85d245c9fe910ef3800f WatchSource:0}: Error finding container 403a9fa9eb1b038f5a55aa99c720f6c46e0d12c2cfbe85d245c9fe910ef3800f: Status 404 returned error can't find the container with id 403a9fa9eb1b038f5a55aa99c720f6c46e0d12c2cfbe85d245c9fe910ef3800f
May 21 16:49:54.025762 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:54.025724    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh" event={"ID":"afd68f93-6a88-48c7-b9e1-3572632287e6","Type":"ContainerStarted","Data":"403a9fa9eb1b038f5a55aa99c720f6c46e0d12c2cfbe85d245c9fe910ef3800f"}
May 21 16:49:55.030037 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:55.030005    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh" event={"ID":"afd68f93-6a88-48c7-b9e1-3572632287e6","Type":"ContainerStarted","Data":"83bd64044ba32960c0e054bc474478ebbd7e14523f3becc935631bbf1658f765"}
May 21 16:49:55.030430 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:55.030145    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:49:55.051534 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:49:55.051473    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh" podStartSLOduration=1.678759591 podStartE2EDuration="3.051453687s" podCreationTimestamp="2026-05-21 16:49:52 +0000 UTC" firstStartedPulling="2026-05-21 16:49:53.334861655 +0000 UTC m=+792.241840590" lastFinishedPulling="2026-05-21 16:49:54.707555744 +0000 UTC m=+793.614534686" observedRunningTime="2026-05-21 16:49:55.050705328 +0000 UTC m=+793.957684287" watchObservedRunningTime="2026-05-21 16:49:55.051453687 +0000 UTC m=+793.958432645"
May 21 16:50:03.978792 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:03.978700    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:03.979264 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:03.979010    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak" containerID="cri-o://3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4" gracePeriod=30
May 21 16:50:05.618523 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:05.618500    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:05.661062 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:05.660977    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jprfs\" (UniqueName: \"kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs\") pod \"9b5b59be-c928-421b-89de-66891547932a\" (UID: \"9b5b59be-c928-421b-89de-66891547932a\") "
May 21 16:50:05.663377 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:05.663342    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs" (OuterVolumeSpecName: "kube-api-access-jprfs") pod "9b5b59be-c928-421b-89de-66891547932a" (UID: "9b5b59be-c928-421b-89de-66891547932a"). InnerVolumeSpecName "kube-api-access-jprfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:50:05.762467 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:05.762432    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jprfs\" (UniqueName: \"kubernetes.io/projected/9b5b59be-c928-421b-89de-66891547932a-kube-api-access-jprfs\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:50:06.035701 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.035665    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-dc2fh"
May 21 16:50:06.065955 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.065904    2559 generic.go:358] "Generic (PLEG): container finished" podID="9b5b59be-c928-421b-89de-66891547932a" containerID="3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4" exitCode=143
May 21 16:50:06.066109 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.065981    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b5b59be-c928-421b-89de-66891547932a","Type":"ContainerDied","Data":"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"}
May 21 16:50:06.066109 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.066004    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.066109 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.066031    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b5b59be-c928-421b-89de-66891547932a","Type":"ContainerDied","Data":"058fb6a0c8ec84b2e0e1fcee3be63336a8892645f8add231513918219ded1844"}
May 21 16:50:06.066109 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.066051    2559 scope.go:117] "RemoveContainer" containerID="3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"
May 21 16:50:06.076563 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.076545    2559 scope.go:117] "RemoveContainer" containerID="3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"
May 21 16:50:06.076834 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:50:06.076815    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4\": container with ID starting with 3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4 not found: ID does not exist" containerID="3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"
May 21 16:50:06.076906 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.076841    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4"} err="failed to get container status \"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4\": rpc error: code = NotFound desc = could not find container \"3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4\": container with ID starting with 3db89f202b55582ae13aa50d9dccba1dee027296b5f5295cf0f003e4a2e7c5a4 not found: ID does not exist"
May 21 16:50:06.088465 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.088441    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:06.094256 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.094231    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:06.118187 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.118157    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:06.118468 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.118457    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak"
May 21 16:50:06.118509 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.118470    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak"
May 21 16:50:06.118546 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.118531    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b5b59be-c928-421b-89de-66891547932a" containerName="keycloak"
May 21 16:50:06.122768 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.122754    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.127401 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.127382    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 21 16:50:06.127509 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.127458    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 21 16:50:06.127994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.127972    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 21 16:50:06.128105 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.128085    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k827r\""
May 21 16:50:06.128174 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.128102    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
May 21 16:50:06.135685 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.135657    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:06.166085 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.166054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c78c5\" (UniqueName: \"kubernetes.io/projected/cb68db0a-f660-4796-9987-793d2325433f-kube-api-access-c78c5\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.166224 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.166101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/cb68db0a-f660-4796-9987-793d2325433f-test-realms\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.267355 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.267320    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/cb68db0a-f660-4796-9987-793d2325433f-test-realms\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.267589 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.267389    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c78c5\" (UniqueName: \"kubernetes.io/projected/cb68db0a-f660-4796-9987-793d2325433f-kube-api-access-c78c5\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.268095 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.268077    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/cb68db0a-f660-4796-9987-793d2325433f-test-realms\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.276140 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.276118    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c78c5\" (UniqueName: \"kubernetes.io/projected/cb68db0a-f660-4796-9987-793d2325433f-kube-api-access-c78c5\") pod \"maas-keycloak-0\" (UID: \"cb68db0a-f660-4796-9987-793d2325433f\") " pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.432268 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.432171    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:06.564358 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:06.564324    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 21 16:50:06.567593 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:50:06.567565    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb68db0a_f660_4796_9987_793d2325433f.slice/crio-26087f149eae5f1144f92bc8b6a08c2b3c021d3e8bbe9a9072873a04f488357f WatchSource:0}: Error finding container 26087f149eae5f1144f92bc8b6a08c2b3c021d3e8bbe9a9072873a04f488357f: Status 404 returned error can't find the container with id 26087f149eae5f1144f92bc8b6a08c2b3c021d3e8bbe9a9072873a04f488357f
May 21 16:50:07.072968 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.072921    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb68db0a-f660-4796-9987-793d2325433f","Type":"ContainerStarted","Data":"048adb9318a7937a174c28f9566bc78649462e7a71bc16f65a09aa936dd27e67"}
May 21 16:50:07.073351 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.072972    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb68db0a-f660-4796-9987-793d2325433f","Type":"ContainerStarted","Data":"26087f149eae5f1144f92bc8b6a08c2b3c021d3e8bbe9a9072873a04f488357f"}
May 21 16:50:07.089304 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.089240    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.794217366 podStartE2EDuration="1.089220881s" podCreationTimestamp="2026-05-21 16:50:06 +0000 UTC" firstStartedPulling="2026-05-21 16:50:06.568892995 +0000 UTC m=+805.475871934" lastFinishedPulling="2026-05-21 16:50:06.863896509 +0000 UTC m=+805.770875449" observedRunningTime="2026-05-21 16:50:07.088709744 +0000 UTC m=+805.995688704" watchObservedRunningTime="2026-05-21 16:50:07.089220881 +0000 UTC m=+805.996199872"
May 21 16:50:07.433299 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.433252    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:07.434912 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.434871    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:07.709041 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:07.708954    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5b59be-c928-421b-89de-66891547932a" path="/var/lib/kubelet/pods/9b5b59be-c928-421b-89de-66891547932a/volumes"
May 21 16:50:08.433172 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:08.433117    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:09.433051 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:09.433004    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:10.433212 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:10.433153    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:11.433237 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:11.433183    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:12.432957 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:12.432881    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:13.433502 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:13.433451    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:14.432674 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:14.432621    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:15.433609 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:15.433566    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:16.433028 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:16.432987    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:16.433318 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:16.433271    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:17.433313 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:17.433260    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:18.432701 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:18.432586    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:19.433158 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:19.433099    2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused"
May 21 16:50:20.559265 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:20.559230    2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 21 16:50:20.577683 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:20.577617    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="cb68db0a-f660-4796-9987-793d2325433f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 16:50:30.566103 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:50:30.566058    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 21 16:51:04.807864 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.807827    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"]
May 21 16:51:04.811024 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.811008    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.823829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.823461    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 16:51:04.823829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.823472    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 16:51:04.823829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.823509    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kw9f8\""
May 21 16:51:04.823829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.823583    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 16:51:04.838327 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.838302    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"]
May 21 16:51:04.879422 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.879594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2c5927-7f22-45b1-8a59-398d0a4dd618-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.879594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.879594 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.879762 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.879762 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.879703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vcnn\" (UniqueName: \"kubernetes.io/projected/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kube-api-access-9vcnn\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.980799 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.980760    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vcnn\" (UniqueName: \"kubernetes.io/projected/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kube-api-access-9vcnn\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981024 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.980868    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981024 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.980900    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2c5927-7f22-45b1-8a59-398d0a4dd618-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981024 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.980962    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981024 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.981006    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981259 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.981039    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981362 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.981341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981689 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.981671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.981764 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.981706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.983532 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.983502    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e2c5927-7f22-45b1-8a59-398d0a4dd618-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.983800 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.983780    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e2c5927-7f22-45b1-8a59-398d0a4dd618-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:04.989181 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:04.989155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vcnn\" (UniqueName: \"kubernetes.io/projected/9e2c5927-7f22-45b1-8a59-398d0a4dd618-kube-api-access-9vcnn\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg\" (UID: \"9e2c5927-7f22-45b1-8a59-398d0a4dd618\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:05.127200 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:05.127099    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:05.265829 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:05.265798    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"]
May 21 16:51:05.269165 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:51:05.269128    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2c5927_7f22_45b1_8a59_398d0a4dd618.slice/crio-9d44f020952df61792680fd20e4a56032ba892d245bb553a8750be4992af7bc0 WatchSource:0}: Error finding container 9d44f020952df61792680fd20e4a56032ba892d245bb553a8750be4992af7bc0: Status 404 returned error can't find the container with id 9d44f020952df61792680fd20e4a56032ba892d245bb553a8750be4992af7bc0
May 21 16:51:05.283276 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:05.283246    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg" event={"ID":"9e2c5927-7f22-45b1-8a59-398d0a4dd618","Type":"ContainerStarted","Data":"9d44f020952df61792680fd20e4a56032ba892d245bb553a8750be4992af7bc0"}
May 21 16:51:11.306561 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:11.306523    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg" event={"ID":"9e2c5927-7f22-45b1-8a59-398d0a4dd618","Type":"ContainerStarted","Data":"ad2157c9542d0642c0489bc283e2435a1d928a1571cabcbbb631826e20719e45"}
May 21 16:51:14.399282 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.399244    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"]
May 21 16:51:14.402384 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.402365    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.404569 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.404546    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 16:51:14.411101 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.411075    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"]
May 21 16:51:14.469137 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.469137 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.469343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c230d9c-5889-4c51-a132-11cf57eeaa9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.469343 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbpl5\" (UniqueName: \"kubernetes.io/projected/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kube-api-access-sbpl5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.469453 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.469453 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.469408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570116 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570084    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c230d9c-5889-4c51-a132-11cf57eeaa9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570126    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbpl5\" (UniqueName: \"kubernetes.io/projected/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kube-api-access-sbpl5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570221    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570254    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570287    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570311 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570308    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570792 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570755    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.570882 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.570804    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.572680 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.572658    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c230d9c-5889-4c51-a132-11cf57eeaa9c-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.573004 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.572976    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c230d9c-5889-4c51-a132-11cf57eeaa9c-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.579105 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.579077    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbpl5\" (UniqueName: \"kubernetes.io/projected/9c230d9c-5889-4c51-a132-11cf57eeaa9c-kube-api-access-sbpl5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c\" (UID: \"9c230d9c-5889-4c51-a132-11cf57eeaa9c\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.714022 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.713902    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:14.859587 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:14.859549    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"]
May 21 16:51:14.863192 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:51:14.863150    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c230d9c_5889_4c51_a132_11cf57eeaa9c.slice/crio-4af1c9b10a40273439dec24683f87ec6360654814dd18ab5681abf2542674f69 WatchSource:0}: Error finding container 4af1c9b10a40273439dec24683f87ec6360654814dd18ab5681abf2542674f69: Status 404 returned error can't find the container with id 4af1c9b10a40273439dec24683f87ec6360654814dd18ab5681abf2542674f69
May 21 16:51:15.323355 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:15.323325    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c" event={"ID":"9c230d9c-5889-4c51-a132-11cf57eeaa9c","Type":"ContainerStarted","Data":"bd6723a559275e395d787e4f93a66e6389abafa97c0c834fc0b4407782356988"}
May 21 16:51:15.323355 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:15.323359    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c" event={"ID":"9c230d9c-5889-4c51-a132-11cf57eeaa9c","Type":"ContainerStarted","Data":"4af1c9b10a40273439dec24683f87ec6360654814dd18ab5681abf2542674f69"}
May 21 16:51:20.352042 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:20.352004    2559 generic.go:358] "Generic (PLEG): container finished" podID="9e2c5927-7f22-45b1-8a59-398d0a4dd618" containerID="ad2157c9542d0642c0489bc283e2435a1d928a1571cabcbbb631826e20719e45" exitCode=0
May 21 16:51:20.352504 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:20.352070    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg" event={"ID":"9e2c5927-7f22-45b1-8a59-398d0a4dd618","Type":"ContainerDied","Data":"ad2157c9542d0642c0489bc283e2435a1d928a1571cabcbbb631826e20719e45"}
May 21 16:51:21.357301 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:21.357265    2559 generic.go:358] "Generic (PLEG): container finished" podID="9c230d9c-5889-4c51-a132-11cf57eeaa9c" containerID="bd6723a559275e395d787e4f93a66e6389abafa97c0c834fc0b4407782356988" exitCode=0
May 21 16:51:21.357732 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:21.357352    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c" event={"ID":"9c230d9c-5889-4c51-a132-11cf57eeaa9c","Type":"ContainerDied","Data":"bd6723a559275e395d787e4f93a66e6389abafa97c0c834fc0b4407782356988"}
May 21 16:51:22.361834 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.361791    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c" event={"ID":"9c230d9c-5889-4c51-a132-11cf57eeaa9c","Type":"ContainerStarted","Data":"32802a33d85c95caba947319b04e8fa23a5d12e6217c8bc4df044c413bd09931"}
May 21 16:51:22.362340 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.362068    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:22.363274 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.363254    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg" event={"ID":"9e2c5927-7f22-45b1-8a59-398d0a4dd618","Type":"ContainerStarted","Data":"628761d8455d4c6c3305558105b724d88246a63847625c7d6057d38e4471a472"}
May 21 16:51:22.363453 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.363426    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:22.382604 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.382558    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c" podStartSLOduration=8.085649642 podStartE2EDuration="8.382545241s" podCreationTimestamp="2026-05-21 16:51:14 +0000 UTC" firstStartedPulling="2026-05-21 16:51:21.358183434 +0000 UTC m=+880.265162377" lastFinishedPulling="2026-05-21 16:51:21.655079036 +0000 UTC m=+880.562057976" observedRunningTime="2026-05-21 16:51:22.380730234 +0000 UTC m=+881.287709193" watchObservedRunningTime="2026-05-21 16:51:22.382545241 +0000 UTC m=+881.289524199"
May 21 16:51:22.402336 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:22.402289    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg" podStartSLOduration=2.146513723 podStartE2EDuration="18.402275631s" podCreationTimestamp="2026-05-21 16:51:04 +0000 UTC" firstStartedPulling="2026-05-21 16:51:05.270963121 +0000 UTC m=+864.177942072" lastFinishedPulling="2026-05-21 16:51:21.526725034 +0000 UTC m=+880.433703980" observedRunningTime="2026-05-21 16:51:22.400822688 +0000 UTC m=+881.307801649" watchObservedRunningTime="2026-05-21 16:51:22.402275631 +0000 UTC m=+881.309254588"
May 21 16:51:33.380205 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:33.380171    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg"
May 21 16:51:33.380966 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:33.380929    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c"
May 21 16:51:41.620084 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:41.620055    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:51:41.620549 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:41.620120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:51:59.520129 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.520095    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"]
May 21 16:51:59.531868 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.531844    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.532748 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.532723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.532870 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.532764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgp2t\" (UniqueName: \"kubernetes.io/projected/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kube-api-access-qgp2t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.532914 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.532856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.532914 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.532908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.533030 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.533002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.533072 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.533036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.533706 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.533687    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"]
May 21 16:51:59.534593 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.534570    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 16:51:59.633754 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633717    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.633994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633767    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.633994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633788    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.633994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633806    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.633994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633848    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.633994 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.633875    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgp2t\" (UniqueName: \"kubernetes.io/projected/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kube-api-access-qgp2t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.634266 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.634214    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.634266 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.634229    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.634383 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.634369    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.636185 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.636164    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.636355 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.636336    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.643030 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.642985    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgp2t\" (UniqueName: \"kubernetes.io/projected/e8cb5144-1c8b-4f25-86d4-b41b289b08f6-kube-api-access-qgp2t\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-pd66k\" (UID: \"e8cb5144-1c8b-4f25-86d4-b41b289b08f6\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.842555 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.842451    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:51:59.980221 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:51:59.980194    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"]
May 21 16:51:59.982465 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:51:59.982439    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cb5144_1c8b_4f25_86d4_b41b289b08f6.slice/crio-9213b2023841f0b7039e9bb6855d6a7d1586cbe497faab87b64a6209d4367886 WatchSource:0}: Error finding container 9213b2023841f0b7039e9bb6855d6a7d1586cbe497faab87b64a6209d4367886: Status 404 returned error can't find the container with id 9213b2023841f0b7039e9bb6855d6a7d1586cbe497faab87b64a6209d4367886
May 21 16:52:00.501347 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:00.501305    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k" event={"ID":"e8cb5144-1c8b-4f25-86d4-b41b289b08f6","Type":"ContainerStarted","Data":"a7b5e320016eca86f1eff2bbb203cb744029650d0521a529634469aae044e803"}
May 21 16:52:00.501347 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:00.501350    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k" event={"ID":"e8cb5144-1c8b-4f25-86d4-b41b289b08f6","Type":"ContainerStarted","Data":"9213b2023841f0b7039e9bb6855d6a7d1586cbe497faab87b64a6209d4367886"}
May 21 16:52:06.523895 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:06.523856    2559 generic.go:358] "Generic (PLEG): container finished" podID="e8cb5144-1c8b-4f25-86d4-b41b289b08f6" containerID="a7b5e320016eca86f1eff2bbb203cb744029650d0521a529634469aae044e803" exitCode=0
May 21 16:52:06.524392 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:06.523929    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k" event={"ID":"e8cb5144-1c8b-4f25-86d4-b41b289b08f6","Type":"ContainerDied","Data":"a7b5e320016eca86f1eff2bbb203cb744029650d0521a529634469aae044e803"}
May 21 16:52:07.529037 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:07.529000    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k" event={"ID":"e8cb5144-1c8b-4f25-86d4-b41b289b08f6","Type":"ContainerStarted","Data":"b1a396e92921994ea2d2a9ac82950bfbd8f895172724a9bc36299865582ad327"}
May 21 16:52:07.529416 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:07.529207    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:52:07.549289 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:07.549223    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k" podStartSLOduration=8.274420942999999 podStartE2EDuration="8.549208876s" podCreationTimestamp="2026-05-21 16:51:59 +0000 UTC" firstStartedPulling="2026-05-21 16:52:06.524591823 +0000 UTC m=+925.431570760" lastFinishedPulling="2026-05-21 16:52:06.799379757 +0000 UTC m=+925.706358693" observedRunningTime="2026-05-21 16:52:07.547035516 +0000 UTC m=+926.454014474" watchObservedRunningTime="2026-05-21 16:52:07.549208876 +0000 UTC m=+926.456187834"
May 21 16:52:18.545926 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:52:18.545890    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-pd66k"
May 21 16:56:41.642077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:41.642049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:56:41.642077 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:41.642073    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 16:56:52.024399 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.024364    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:56:52.024880 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.024589    2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" podUID="551f7c94-4da2-4f13-b88c-817fc7854140" containerName="manager" containerID="cri-o://403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2" gracePeriod=30
May 21 16:56:52.279247 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.279189    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:56:52.371220 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.371194    2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg8p2\" (UniqueName: \"kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2\") pod \"551f7c94-4da2-4f13-b88c-817fc7854140\" (UID: \"551f7c94-4da2-4f13-b88c-817fc7854140\") "
May 21 16:56:52.373196 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.373169    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2" (OuterVolumeSpecName: "kube-api-access-rg8p2") pod "551f7c94-4da2-4f13-b88c-817fc7854140" (UID: "551f7c94-4da2-4f13-b88c-817fc7854140"). InnerVolumeSpecName "kube-api-access-rg8p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 16:56:52.472011 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.471982    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg8p2\" (UniqueName: \"kubernetes.io/projected/551f7c94-4da2-4f13-b88c-817fc7854140-kube-api-access-rg8p2\") on node \"ip-10-0-143-162.ec2.internal\" DevicePath \"\""
May 21 16:56:52.512932 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.512902    2559 generic.go:358] "Generic (PLEG): container finished" podID="551f7c94-4da2-4f13-b88c-817fc7854140" containerID="403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2" exitCode=0
May 21 16:56:52.513086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.512977    2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-4jjzs"
May 21 16:56:52.513086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.512990    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" event={"ID":"551f7c94-4da2-4f13-b88c-817fc7854140","Type":"ContainerDied","Data":"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"}
May 21 16:56:52.513086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.513035    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-4jjzs" event={"ID":"551f7c94-4da2-4f13-b88c-817fc7854140","Type":"ContainerDied","Data":"9dd746a239d51f0ebd50d25ae6b915606771c7d7dba0c07b64c40c60a0b58e25"}
May 21 16:56:52.513086 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.513054    2559 scope.go:117] "RemoveContainer" containerID="403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"
May 21 16:56:52.521365 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.521347    2559 scope.go:117] "RemoveContainer" containerID="403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"
May 21 16:56:52.521590 ip-10-0-143-162 kubenswrapper[2559]: E0521 16:56:52.521573    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2\": container with ID starting with 403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2 not found: ID does not exist" containerID="403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"
May 21 16:56:52.521652 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.521603    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2"} err="failed to get container status \"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2\": rpc error: code = NotFound desc = could not find container \"403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2\": container with ID starting with 403baac836f4ac17f5bf7fdbd5346237755edfb7585ae7e064fafd6e219dfbc2 not found: ID does not exist"
May 21 16:56:52.536723 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.536678    2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:56:52.542794 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:52.542775    2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-4jjzs"]
May 21 16:56:53.320944 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.320913    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c8bd6554-jq8rz"]
May 21 16:56:53.321330 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.321292    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551f7c94-4da2-4f13-b88c-817fc7854140" containerName="manager"
May 21 16:56:53.321330 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.321307    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="551f7c94-4da2-4f13-b88c-817fc7854140" containerName="manager"
May 21 16:56:53.321417 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.321379    2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="551f7c94-4da2-4f13-b88c-817fc7854140" containerName="manager"
May 21 16:56:53.325891 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.325867    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:53.328088 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.328067    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 16:56:53.328591 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.328111    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h7qxw\""
May 21 16:56:53.337575 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.337554    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-jq8rz"]
May 21 16:56:53.480320 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.480286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfbf\" (UniqueName: \"kubernetes.io/projected/c6966193-9de0-439c-bfd4-233b73616adf-kube-api-access-jnfbf\") pod \"maas-controller-56c8bd6554-jq8rz\" (UID: \"c6966193-9de0-439c-bfd4-233b73616adf\") " pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:53.580904 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.580822    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfbf\" (UniqueName: \"kubernetes.io/projected/c6966193-9de0-439c-bfd4-233b73616adf-kube-api-access-jnfbf\") pod \"maas-controller-56c8bd6554-jq8rz\" (UID: \"c6966193-9de0-439c-bfd4-233b73616adf\") " pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:53.590472 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.590439    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfbf\" (UniqueName: \"kubernetes.io/projected/c6966193-9de0-439c-bfd4-233b73616adf-kube-api-access-jnfbf\") pod \"maas-controller-56c8bd6554-jq8rz\" (UID: \"c6966193-9de0-439c-bfd4-233b73616adf\") " pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:53.638134 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.638096    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:53.707516 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.707484    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="551f7c94-4da2-4f13-b88c-817fc7854140" path="/var/lib/kubelet/pods/551f7c94-4da2-4f13-b88c-817fc7854140/volumes"
May 21 16:56:53.761592 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.761554    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c8bd6554-jq8rz"]
May 21 16:56:53.767421 ip-10-0-143-162 kubenswrapper[2559]: W0521 16:56:53.767395    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6966193_9de0_439c_bfd4_233b73616adf.slice/crio-d6ffe821f8f0e9534076d8f6ce19ee0d7259ffbdd9e9af9adb73cb472c6e0c58 WatchSource:0}: Error finding container d6ffe821f8f0e9534076d8f6ce19ee0d7259ffbdd9e9af9adb73cb472c6e0c58: Status 404 returned error can't find the container with id d6ffe821f8f0e9534076d8f6ce19ee0d7259ffbdd9e9af9adb73cb472c6e0c58
May 21 16:56:53.769018 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:53.769003    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:56:54.521472 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:54.521440    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-jq8rz" event={"ID":"c6966193-9de0-439c-bfd4-233b73616adf","Type":"ContainerStarted","Data":"02368d41725a09da5ef5464dc0080d2f61f4514f4ec3963810bfec52e186e38e"}
May 21 16:56:54.521472 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:54.521478    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c8bd6554-jq8rz" event={"ID":"c6966193-9de0-439c-bfd4-233b73616adf","Type":"ContainerStarted","Data":"d6ffe821f8f0e9534076d8f6ce19ee0d7259ffbdd9e9af9adb73cb472c6e0c58"}
May 21 16:56:54.521903 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:54.521577    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 16:56:54.539466 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:56:54.539409    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-56c8bd6554-jq8rz" podStartSLOduration=1.066836516 podStartE2EDuration="1.539393514s" podCreationTimestamp="2026-05-21 16:56:53 +0000 UTC" firstStartedPulling="2026-05-21 16:56:53.769129392 +0000 UTC m=+1212.676108328" lastFinishedPulling="2026-05-21 16:56:54.241686373 +0000 UTC m=+1213.148665326" observedRunningTime="2026-05-21 16:56:54.538484549 +0000 UTC m=+1213.445463506" watchObservedRunningTime="2026-05-21 16:56:54.539393514 +0000 UTC m=+1213.446372473"
May 21 16:57:05.531038 ip-10-0-143-162 kubenswrapper[2559]: I0521 16:57:05.531009    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c8bd6554-jq8rz"
May 21 17:01:41.665074 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:01:41.665042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:01:41.665572 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:01:41.665042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:06:41.687121 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:06:41.687088    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:06:41.689124 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:06:41.689105    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:11:41.710130 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:11:41.710101    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:11:41.713017 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:11:41.713001    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:16:41.734283 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:16:41.734173    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:16:41.736947 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:16:41.735644    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:18:12.252688 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:12.252658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-8w6qs_3112c9b0-9af1-4b20-8b9e-e67b3501b341/manager/0.log"
May 21 17:18:12.735799 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:12.735717    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c8bd6554-jq8rz_c6966193-9de0-439c-bfd4-233b73616adf/manager/0.log"
May 21 17:18:12.854645 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:12.854614    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b9hfc_0e3b1946-ebe3-4c1e-a099-eda33a6c61e5/manager/2.log"
May 21 17:18:13.203344 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:13.203312    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cfc76844-wrkxc_4f023576-78e3-4fda-bfaf-fb0d0017605a/manager/0.log"
May 21 17:18:14.659826 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:14.659792    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6zgxz_a2ac4434-21dd-4a58-b7c8-0357bb079fa9/manager/0.log"
May 21 17:18:14.768461 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:14.768433    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dh5l8_245ff4f4-8ddc-47de-9e61-d224b1dea820/manager/0.log"
May 21 17:18:14.995603 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:14.995525    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hns2v_0e9b0809-3102-4370-9e4c-7b90041570d8/registry-server/0.log"
May 21 17:18:15.382730 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:15.382706    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zr7f4_cc24254b-b262-4309-b305-4096008adbf6/manager/0.log"
May 21 17:18:15.839716 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:15.839681    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5gpcb_8aa3b584-7f1d-45d4-92c8-72ccaa1e0283/discovery/0.log"
May 21 17:18:16.047597 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.047569    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ddccfd95-rp7kk_b95558db-c746-40bb-8d9b-655023b61bc5/kube-auth-proxy/0.log"
May 21 17:18:16.285199 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.285167    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-dc2fh_afd68f93-6a88-48c7-b9e1-3572632287e6/payload-processing/0.log"
May 21 17:18:16.853142 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.853113    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c_9c230d9c-5889-4c51-a132-11cf57eeaa9c/storage-initializer/0.log"
May 21 17:18:16.860528 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.860508    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-rwn7c_9c230d9c-5889-4c51-a132-11cf57eeaa9c/main/0.log"
May 21 17:18:16.972684 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.972656    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pd66k_e8cb5144-1c8b-4f25-86d4-b41b289b08f6/storage-initializer/0.log"
May 21 17:18:16.979575 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:16.979557    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-pd66k_e8cb5144-1c8b-4f25-86d4-b41b289b08f6/main/0.log"
May 21 17:18:17.313050 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:17.313021    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg_9e2c5927-7f22-45b1-8a59-398d0a4dd618/storage-initializer/0.log"
May 21 17:18:17.330873 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:17.330848    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-5d4fg_9e2c5927-7f22-45b1-8a59-398d0a4dd618/main/0.log"
May 21 17:18:24.894511 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:24.894475    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q7qg5_40589b6b-0b94-4d0d-93aa-f5c96a6455de/global-pull-secret-syncer/0.log"
May 21 17:18:24.998451 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:24.998416    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dxgk6_48630100-e2a0-41f6-96e3-667310381bcf/konnectivity-agent/0.log"
May 21 17:18:25.094199 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:25.094169    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-162.ec2.internal_614b87cc09b6d11250a98b5fd2eae5c6/haproxy/0.log"
May 21 17:18:29.502447 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:29.502413    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6zgxz_a2ac4434-21dd-4a58-b7c8-0357bb079fa9/manager/0.log"
May 21 17:18:29.524838 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:29.524805    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dh5l8_245ff4f4-8ddc-47de-9e61-d224b1dea820/manager/0.log"
May 21 17:18:29.591608 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:29.591575    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hns2v_0e9b0809-3102-4370-9e4c-7b90041570d8/registry-server/0.log"
May 21 17:18:29.759591 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:29.759512    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zr7f4_cc24254b-b262-4309-b305-4096008adbf6/manager/0.log"
May 21 17:18:31.485503 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:31.485476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlg9h_e61012a8-1d52-4a7d-a7e7-7b98df88979d/node-exporter/0.log"
May 21 17:18:31.509755 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:31.509726    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlg9h_e61012a8-1d52-4a7d-a7e7-7b98df88979d/kube-rbac-proxy/0.log"
May 21 17:18:31.530692 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:31.530668    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlg9h_e61012a8-1d52-4a7d-a7e7-7b98df88979d/init-textfile/0.log"
May 21 17:18:33.087308 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.087280    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-6dvtk_6e98cd3f-9991-4e95-971a-4f658ef6b0e4/networking-console-plugin/0.log"
May 21 17:18:33.363619 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.363547    2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"]
May 21 17:18:33.367056 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.367040    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.369001 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.368976    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2qk5\"/\"openshift-service-ca.crt\""
May 21 17:18:33.369173 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.369156    2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z2qk5\"/\"kube-root-ca.crt\""
May 21 17:18:33.369808 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.369743    2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z2qk5\"/\"default-dockercfg-z5vzj\""
May 21 17:18:33.372300 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.372278    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"]
May 21 17:18:33.422117 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.422081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kv4d\" (UniqueName: \"kubernetes.io/projected/890c12ad-9508-4f89-853d-e9ad68ecb184-kube-api-access-2kv4d\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.422262 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.422124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-lib-modules\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.422262 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.422153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-podres\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.422339 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.422260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-sys\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.422339 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.422285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-proc\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.522915 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.522879    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-sys\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.522915 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.522918    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-proc\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.522965    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kv4d\" (UniqueName: \"kubernetes.io/projected/890c12ad-9508-4f89-853d-e9ad68ecb184-kube-api-access-2kv4d\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.522988    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-lib-modules\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.523060    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-proc\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.523089    2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-podres\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.523153    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-sys\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.523158    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-lib-modules\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.523188 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.523190    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/890c12ad-9508-4f89-853d-e9ad68ecb184-podres\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.530569 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.530548    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kv4d\" (UniqueName: \"kubernetes.io/projected/890c12ad-9508-4f89-853d-e9ad68ecb184-kube-api-access-2kv4d\") pod \"perf-node-gather-daemonset-xlfq2\" (UID: \"890c12ad-9508-4f89-853d-e9ad68ecb184\") " pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.680137 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.680050    2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:33.806353 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.806323    2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"]
May 21 17:18:33.809338 ip-10-0-143-162 kubenswrapper[2559]: W0521 17:18:33.809312    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod890c12ad_9508_4f89_853d_e9ad68ecb184.slice/crio-59384486ca879bfd86a25b23d65d63f058186910cd17990be389c0f411824c79 WatchSource:0}: Error finding container 59384486ca879bfd86a25b23d65d63f058186910cd17990be389c0f411824c79: Status 404 returned error can't find the container with id 59384486ca879bfd86a25b23d65d63f058186910cd17990be389c0f411824c79
May 21 17:18:33.810897 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.810880    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:18:33.903466 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:33.903432    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2" event={"ID":"890c12ad-9508-4f89-853d-e9ad68ecb184","Type":"ContainerStarted","Data":"59384486ca879bfd86a25b23d65d63f058186910cd17990be389c0f411824c79"}
May 21 17:18:34.908145 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:34.908111    2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2" event={"ID":"890c12ad-9508-4f89-853d-e9ad68ecb184","Type":"ContainerStarted","Data":"b50c94cf46b72e272e12523019e725cf9e946fddf90a7187497ed758f7a817f3"}
May 21 17:18:34.908538 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:34.908233    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:34.922101 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:34.922058    2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2" podStartSLOduration=1.92204407 podStartE2EDuration="1.92204407s" podCreationTimestamp="2026-05-21 17:18:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:18:34.921365012 +0000 UTC m=+2513.828343981" watchObservedRunningTime="2026-05-21 17:18:34.92204407 +0000 UTC m=+2513.829023032"
May 21 17:18:35.449259 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:35.449228    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmlw9_e2814a31-d63c-41f6-8a1c-fdc3adbc305a/dns/0.log"
May 21 17:18:35.471252 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:35.471227    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmlw9_e2814a31-d63c-41f6-8a1c-fdc3adbc305a/kube-rbac-proxy/0.log"
May 21 17:18:35.515631 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:35.515604    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjk2q_dc63d811-c624-43ca-932f-cbed4e185260/dns-node-resolver/0.log"
May 21 17:18:36.039890 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:36.039859    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9v4xh_429870d1-37a9-4902-a7e6-9f907b0cf382/node-ca/0.log"
May 21 17:18:37.028866 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:37.028838    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5gpcb_8aa3b584-7f1d-45d4-92c8-72ccaa1e0283/discovery/0.log"
May 21 17:18:37.066420 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:37.066386    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59ddccfd95-rp7kk_b95558db-c746-40bb-8d9b-655023b61bc5/kube-auth-proxy/0.log"
May 21 17:18:37.223972 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:37.223922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-dc2fh_afd68f93-6a88-48c7-b9e1-3572632287e6/payload-processing/0.log"
May 21 17:18:37.713074 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:37.713041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dl7vd_2111f36b-3a34-4262-8653-27c5ba27dc8a/serve-healthcheck-canary/0.log"
May 21 17:18:38.346434 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:38.346407    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5k82_61605b25-fe7e-4368-84c7-3f68d9654029/kube-rbac-proxy/0.log"
May 21 17:18:38.363623 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:38.363594    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5k82_61605b25-fe7e-4368-84c7-3f68d9654029/exporter/0.log"
May 21 17:18:38.382110 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:38.382074    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5k82_61605b25-fe7e-4368-84c7-3f68d9654029/extractor/0.log"
May 21 17:18:40.262049 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.262007    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-8w6qs_3112c9b0-9af1-4b20-8b9e-e67b3501b341/manager/0.log"
May 21 17:18:40.450681 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.450644    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c8bd6554-jq8rz_c6966193-9de0-439c-bfd4-233b73616adf/manager/0.log"
May 21 17:18:40.468646 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.468615    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b9hfc_0e3b1946-ebe3-4c1e-a099-eda33a6c61e5/manager/1.log"
May 21 17:18:40.490765 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.490738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b9hfc_0e3b1946-ebe3-4c1e-a099-eda33a6c61e5/manager/2.log"
May 21 17:18:40.603350 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.603266    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cfc76844-wrkxc_4f023576-78e3-4fda-bfaf-fb0d0017605a/manager/0.log"
May 21 17:18:40.921173 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:40.921098    2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z2qk5/perf-node-gather-daemonset-xlfq2"
May 21 17:18:47.633510 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.633480    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9td9l_5f67ad56-5c6c-4860-8d8b-5e8e51d2eb06/kube-multus/0.log"
May 21 17:18:47.656739 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.656707    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/kube-multus-additional-cni-plugins/0.log"
May 21 17:18:47.675000 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.674977    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/egress-router-binary-copy/0.log"
May 21 17:18:47.693382 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.693362    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/cni-plugins/0.log"
May 21 17:18:47.710207 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.710186    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/bond-cni-plugin/0.log"
May 21 17:18:47.727053 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.727033    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/routeoverride-cni/0.log"
May 21 17:18:47.746778 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.746753    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/whereabouts-cni-bincopy/0.log"
May 21 17:18:47.765424 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:47.765401    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b9b9d_c99c241b-a610-4932-885d-c36fcf4af460/whereabouts-cni/0.log"
May 21 17:18:48.104078 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:48.104047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-78bbj_bf3aa270-6245-4d85-80c4-d7a428ae658b/network-metrics-daemon/0.log"
May 21 17:18:48.119793 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:48.119767    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-78bbj_bf3aa270-6245-4d85-80c4-d7a428ae658b/kube-rbac-proxy/0.log"
May 21 17:18:48.972692 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:48.972663    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-controller/0.log"
May 21 17:18:48.992359 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:48.992300    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/0.log"
May 21 17:18:49.015368 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.015336    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovn-acl-logging/1.log"
May 21 17:18:49.036140 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.036112    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/kube-rbac-proxy-node/0.log"
May 21 17:18:49.059755 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.059733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/kube-rbac-proxy-ovn-metrics/0.log"
May 21 17:18:49.079390 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.079371    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/northd/0.log"
May 21 17:18:49.099465 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.099444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/nbdb/0.log"
May 21 17:18:49.123242 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.123220    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/sbdb/0.log"
May 21 17:18:49.293459 ip-10-0-143-162 kubenswrapper[2559]: I0521 17:18:49.293424    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5hnwh_3f468f62-9e3b-4fd8-a375-b63c33841d9d/ovnkube-controller/0.log"