May 26 19:47:16.614638 ip-10-0-141-124 systemd[1]: Starting Kubernetes Kubelet...
May 26 19:47:17.114789 ip-10-0-141-124 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:47:17.114789 ip-10-0-141-124 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 19:47:17.114789 ip-10-0-141-124 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:47:17.114789 ip-10-0-141-124 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 19:47:17.114789 ip-10-0-141-124 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:47:17.118302 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.118121    2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 19:47:17.122994 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.122972    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:47:17.122994 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.122993    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:47:17.122994 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.122998    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123001    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123005    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123008    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123013    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123016    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123019    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123021    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123024    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123027    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123030    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123033    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123036    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123039    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123044    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123048    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123051    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123054    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123058    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:47:17.123099 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123070    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123073    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123076    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123079    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123081    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123084    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123087    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123090    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123092    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123096    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123099    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123101    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123104    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123107    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123110    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123113    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123116    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123118    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123121    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123123    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:47:17.123603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123126    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123129    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123133    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123137    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123140    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123142    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123145    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123147    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123150    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123153    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123155    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123158    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123161    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123164    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123167    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123169    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123172    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123174    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123177    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:47:17.124087 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123180    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123183    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123185    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123187    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123190    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123192    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123195    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123197    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123200    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123203    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123207    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123210    2573 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123212    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123215    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123217    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123221    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123224    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123227    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123229    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123232    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:47:17.124639 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123235    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123237    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123240    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123242    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123245    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123248    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123689    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123695    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123698    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123701    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123703    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123706    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123709    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123712    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123715    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123717    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123720    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123723    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123725    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:47:17.125129 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123728    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123730    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123733    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123735    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123738    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123740    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123743    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123746    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123749    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123752    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123756    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123759    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123761    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123764    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123766    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123770    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123774    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123776    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123779    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:47:17.125603 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123782    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123785    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123787    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123790    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123793    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123795    2573 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123798    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123800    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123803    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123805    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123808    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123816    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123819    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123821    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123824    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123826    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123829    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123831    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123834    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123837    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:47:17.126106 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123839    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123842    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123845    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123848    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123852    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123856    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123859    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123862    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123865    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123868    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123871    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123873    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123877    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123879    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123882    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123884    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123887    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123890    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123892    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123895    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:47:17.126613 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123897    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123900    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123903    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123905    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123908    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123910    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123912    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123915    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123917    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123920    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123922    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123925    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123927    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.123930    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124007    2573 flags.go:64] FLAG: --address="0.0.0.0"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124017    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124026    2573 flags.go:64] FLAG: --anonymous-auth="true"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124030    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124035    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124038    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124042    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 19:47:17.127113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124047    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124050    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124054    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124058    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124061    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124064    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124068    2573 flags.go:64] FLAG: --cgroup-root=""
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124071    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124074    2573 flags.go:64] FLAG: --client-ca-file=""
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124077    2573 flags.go:64] FLAG: --cloud-config=""
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124080    2573 flags.go:64] FLAG: --cloud-provider="external"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124083    2573 flags.go:64] FLAG: --cluster-dns="[]"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124087    2573 flags.go:64] FLAG: --cluster-domain=""
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124090    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124093    2573 flags.go:64] FLAG: --config-dir=""
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124096    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124100    2573 flags.go:64] FLAG: --container-log-max-files="5"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124104    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124107    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124110    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124114    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124117    2573 flags.go:64] FLAG: --contention-profiling="false"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124120    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124123    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124126    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 19:47:17.127637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124130    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124134    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124144    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124148    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124151    2573 flags.go:64] FLAG: --enable-load-reader="false"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124154    2573 flags.go:64] FLAG: --enable-server="true"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124157    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124162    2573 flags.go:64] FLAG: --event-burst="100"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124165    2573 flags.go:64] FLAG: --event-qps="50"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124168    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124172    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124175    2573 flags.go:64] FLAG: --eviction-hard=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124179    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124181    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124184    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124187    2573 flags.go:64] FLAG: --eviction-soft=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124190    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124193    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124196    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124200    2573 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124202    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124205    2573 flags.go:64] FLAG: --fail-swap-on="true"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124208    2573 flags.go:64] FLAG: --feature-gates=""
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124213    2573 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124216    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 19:47:17.128237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124219    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124222    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124225    2573 flags.go:64] FLAG: --healthz-port="10248"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124228    2573 flags.go:64] FLAG: --help="false"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124231    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-124.ec2.internal"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124234    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124240    2573 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124243    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124247    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124250    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124253    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124256    2573 flags.go:64] FLAG: --image-service-endpoint=""
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124259    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124262    2573 flags.go:64] FLAG: --kube-api-burst="100"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124265    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124269    2573 flags.go:64] FLAG: --kube-api-qps="50"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124271    2573 flags.go:64] FLAG: --kube-reserved=""
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124274    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124277    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124281    2573 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124283    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124286    2573 flags.go:64] FLAG: --lock-file=""
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124289    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124292    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 19:47:17.128853 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124295    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124301    2573 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124304    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124307    2573 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124310    2573 flags.go:64] FLAG: --logging-format="text"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124313    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124316    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124319    2573 flags.go:64] FLAG: --manifest-url=""
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124322    2573 flags.go:64] FLAG: --manifest-url-header=""
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124344    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124347    2573 flags.go:64] FLAG: --max-open-files="1000000"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124356    2573 flags.go:64] FLAG: --max-pods="110"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124359    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124362    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124366    2573 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124369    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124373    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124376    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124379    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124388    2573 flags.go:64] FLAG: --node-status-max-images="50"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124391    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124394    2573 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124397    2573 flags.go:64] FLAG: --pod-cidr=""
May 26 19:47:17.129447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124400    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124407    2573 flags.go:64] FLAG: --pod-manifest-path=""
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124410    2573 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124413    2573 flags.go:64] FLAG: --pods-per-core="0"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124416    2573 flags.go:64] FLAG: --port="10250"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124419    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124422    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0295baf16186f1b36"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124426    2573 flags.go:64] FLAG: --qos-reserved=""
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124429    2573 flags.go:64] FLAG: --read-only-port="10255"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124432    2573 flags.go:64] FLAG: --register-node="true"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124435    2573 flags.go:64] FLAG: --register-schedulable="true"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124438    2573 flags.go:64] FLAG: --register-with-taints=""
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124442    2573 flags.go:64] FLAG: --registry-burst="10"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124445    2573 flags.go:64] FLAG: --registry-qps="5"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124448    2573 flags.go:64] FLAG: --reserved-cpus=""
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124450    2573 flags.go:64] FLAG: --reserved-memory=""
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124455    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124458    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124461    2573 flags.go:64] FLAG: --rotate-certificates="false"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124464    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124467    2573 flags.go:64] FLAG: --runonce="false"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124470    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124473    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124476    2573 flags.go:64] FLAG: --seccomp-default="false"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124480    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124489    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 19:47:17.129987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124492    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124495    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124499    2573 flags.go:64] FLAG: --storage-driver-password="root"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124502    2573 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124505    2573 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124508    2573 flags.go:64] FLAG: --storage-driver-user="root"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124511    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124514    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124517    2573 flags.go:64] FLAG: --system-cgroups=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124520    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124526    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124529    2573 flags.go:64] FLAG: --tls-cert-file=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124531    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124535    2573 flags.go:64] FLAG: --tls-min-version=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124538    2573 flags.go:64] FLAG: --tls-private-key-file=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124541    2573 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124544    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124546    2573 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124549    2573 flags.go:64] FLAG: --v="2"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124554    2573 flags.go:64] FLAG: --version="false"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124558    2573 flags.go:64] FLAG: --vmodule=""
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124562    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.124565    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124665    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:47:17.130617 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124671    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124674    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124677    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124680    2573 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124683    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124686    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124690    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124694    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124697    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124700    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124703    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124706    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124709    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124712    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124715    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124717    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124720    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124722    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124725    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124728    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:47:17.131188 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124737    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124741    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124744    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124747    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124750    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124753    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124756    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124758    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124761    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124764    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124767    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124770    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124772    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124775    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124778    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124780    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124783    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124785    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124789    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124793    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:47:17.131736 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124796    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124798    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124801    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124804    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124806    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124810    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124813    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124815    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124818    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124820    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124823    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124825    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124828    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124830    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124833    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124835    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124838    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124841    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124843    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124846    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:47:17.132214 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124848    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124851    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124854    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124856    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124858    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124861    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124863    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124866    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124869    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124871    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124875    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124879    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124881    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124884    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124886    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124889    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124893    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124896    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124906    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:47:17.132739 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124908    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124911    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124914    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124916    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124919    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.124922    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:47:17.133199 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.125758    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:47:17.133560 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.133538    2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 19:47:17.133594 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.133561    2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 19:47:17.133624 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133612    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:47:17.133624 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133618    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:47:17.133624 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133621    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:47:17.133624 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133625    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133628    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133631    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133634    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133638    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133641    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133643    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133648    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133653    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133656    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133659    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133662    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133665    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133668    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133671    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133673    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133677    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133679    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133682    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:47:17.133723 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133684    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133687    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133689    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133692    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133695    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133697    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133700    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133702    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133705    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133709    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133711    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133714    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133717    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133719    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133722    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133726    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133729    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133732    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133735    2573 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133737    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:47:17.134184 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133740    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133743    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133746    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133748    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133752    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133756    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133759    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133762    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133764    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133767    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133769    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133772    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133774    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133777    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133779    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133782    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133785    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133787    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133790    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133793    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:47:17.134680 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133795    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133797    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133801    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133803    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133806    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133808    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133811    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133815    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133818    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133821    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133823    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133826    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133829    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133831    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133835    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133837    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133840    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133842    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133845    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133848    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:47:17.135195 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133851    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133853    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133856    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133859    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.133865    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133985    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133991    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133995    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.133998    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134001    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134004    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134007    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134010    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134013    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134015    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:47:17.135700 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134018    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134021    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134024    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134026    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134030    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134033    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134035    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134038    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134040    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134043    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134046    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134048    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134051    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134054    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134056    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134059    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134061    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134064    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134067    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134070    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:47:17.136064 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134072    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134075    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134077    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134079    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134082    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134084    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134087    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134091    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134095    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134098    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134100    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134103    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134106    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134109    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134112    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134115    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134118    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134122    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134125    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:47:17.136575 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134128    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134130    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134133    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134135    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134138    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134140    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134143    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134145    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134148    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134150    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134153    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134155    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134158    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134160    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134163    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134165    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134168    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134171    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134175    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134178    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:47:17.137043 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134180    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134183    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134186    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134188    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134191    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134194    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134197    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134200    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134203    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134206    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134209    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134212    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134214    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134217    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134219    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134222    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:47:17.137549 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:17.134224    2573 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:47:17.137944 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.134229    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:47:17.137944 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.135132    2573 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 19:47:17.138600 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.138585    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 19:47:17.139774 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.139763    2573 server.go:1019] "Starting client certificate rotation"
May 26 19:47:17.139893 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.139876    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:47:17.139926 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.139911    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:47:17.169492 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.169469    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:47:17.171388 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.171367    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:47:17.189112 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.189080    2573 log.go:25] "Validated CRI v1 runtime API"
May 26 19:47:17.195467 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.195441    2573 log.go:25] "Validated CRI v1 image API"
May 26 19:47:17.197037 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.197016    2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 19:47:17.201528 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.201494    2573 fs.go:135] Filesystem UUIDs: map[61987d34-d085-4fd6-aa66-b30fb95c9373:/dev/nvme0n1p3 78cb74e8-2cdc-4bce-aacf-25b91c4c6e82:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 26 19:47:17.201620 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.201522    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 19:47:17.203812 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.203789    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:47:17.206066 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.205956    2573 manager.go:217] Machine: {Timestamp:2026-05-26 19:47:17.205450993 +0000 UTC m=+0.458522974 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099802 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed9faa80b4f0baef0c3ddfec69021 SystemUUID:ec2ed9fa-a80b-4f0b-aef0-c3ddfec69021 BootID:597a0304-2a07-4dca-8e03-f6215b1657d2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:a2:54:ec:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:a2:54:ec:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:93:8f:b4:9d:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 19:47:17.206736 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.206725    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 19:47:17.206827 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.206814    2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 19:47:17.210094 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.210061    2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 19:47:17.210241 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.210094    2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 19:47:17.210288 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.210247    2573 topology_manager.go:138] "Creating topology manager with none policy"
May 26 19:47:17.210288 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.210256    2573 container_manager_linux.go:306] "Creating device plugin manager"
May 26 19:47:17.210288 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.210269    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:47:17.211300 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.211290    2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:47:17.213788 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.213776    2573 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:47:17.213915 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.213905    2573 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 19:47:17.216660 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.216649    2573 kubelet.go:491] "Attempting to sync node with API server"
May 26 19:47:17.216704 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.216663    2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 19:47:17.216704 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.216675    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 19:47:17.216704 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.216684    2573 kubelet.go:397] "Adding apiserver pod source"
May 26 19:47:17.216704 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.216695    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 19:47:17.217997 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.217980    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:47:17.217997 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.217999    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:47:17.221495 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.221478    2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 19:47:17.223703 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.223688    2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 19:47:17.224737 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224708    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224742    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224751    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224760    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224769    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224775    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224781    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224787    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224793    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224799    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 19:47:17.224814 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.224809    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 19:47:17.225220 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.225160    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 19:47:17.226217 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.226205    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 19:47:17.226217 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.226215    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 19:47:17.230698 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.230669    2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 19:47:17.230794 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.230698    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 19:47:17.230794 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.230761    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 19:47:17.230927 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.230914    2573 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 19:47:17.230981 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.230969    2573 server.go:1295] "Started kubelet"
May 26 19:47:17.232415 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.231608    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 19:47:17.231793 ip-10-0-141-124 systemd[1]: Started Kubernetes Kubelet.
May 26 19:47:17.232596 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.232430    2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 19:47:17.232596 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.232518    2573 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 19:47:17.233921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.233899    2573 server.go:317] "Adding debug handlers to kubelet server"
May 26 19:47:17.234019 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.233984    2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 19:47:17.241871 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.240842    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18b3354271912190  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-05-26 19:47:17.230928272 +0000 UTC m=+0.484000259,LastTimestamp:2026-05-26 19:47:17.230928272 +0000 UTC m=+0.484000259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}"
May 26 19:47:17.245486 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.245467    2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 19:47:17.246019 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246006    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 19:47:17.246099 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246023    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 19:47:17.246206 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246191    2573 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 19:47:17.246250 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246209    2573 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 19:47:17.246378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246367    2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 19:47:17.246426 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246422    2573 reconstruct.go:97] "Volume reconstruction finished"
May 26 19:47:17.246455 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.246430    2573 reconciler.go:26] "Reconciler: start to sync state"
May 26 19:47:17.247167 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247153    2573 factory.go:55] Registering systemd factory
May 26 19:47:17.247244 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247171    2573 factory.go:223] Registration of the systemd container factory successfully
May 26 19:47:17.247244 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.247224    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.247520 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247505    2573 factory.go:153] Registering CRI-O factory
May 26 19:47:17.247600 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247524    2573 factory.go:223] Registration of the crio container factory successfully
May 26 19:47:17.247600 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247580    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 19:47:17.247600 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247598    2573 factory.go:103] Registering Raw factory
May 26 19:47:17.247722 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.247618    2573 manager.go:1196] Started watching for new ooms in manager
May 26 19:47:17.248552 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.248524    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-trbbm"
May 26 19:47:17.248943 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.248927    2573 manager.go:319] Starting recovery of all containers
May 26 19:47:17.257189 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.257062    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 19:47:17.257189 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.257083    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 19:47:17.258682 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.258660    2573 manager.go:324] Recovery completed
May 26 19:47:17.260563 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.260544    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-trbbm"
May 26 19:47:17.263013 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.262999    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.264850 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.264834    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.264916 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.264868    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.264916 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.264878    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.265398 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.265379    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 19:47:17.265398 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.265397    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 19:47:17.265529 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.265417    2573 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:47:17.269429 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.269411    2573 policy_none.go:49] "None policy: Start"
May 26 19:47:17.269429 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.269429    2573 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 19:47:17.269575 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.269442    2573 state_mem.go:35] "Initializing new in-memory state store"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310244    2573 manager.go:341] "Starting Device Plugin manager"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.310281    2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310291    2573 server.go:85] "Starting device plugin registration server"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310565    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310578    2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310672    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310763    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.310771    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.311384    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.311417    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.313849    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.315028    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.315045    2573 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.315063    2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.315070    2573 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.315105    2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 19:47:17.325895 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.316961    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:47:17.411111 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.411006    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.412066 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.412046    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.412159 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.412079    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.412159 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.412090    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.412159 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.412118    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-124.ec2.internal"
May 26 19:47:17.416186 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.416167    2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"]
May 26 19:47:17.416245 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.416236    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.417936 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.417918    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.417996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.417949    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.417996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.417959    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.420424 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.420411    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.420564 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.420549    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.420607 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.420580    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.420915 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.420899    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-124.ec2.internal"
May 26 19:47:17.420988 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.420922    2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-124.ec2.internal\": node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.421131 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421117    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.421192 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421150    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.421192 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421166    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.421192 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421120    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.421316 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421213    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.421316 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.421226    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.423534 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.423518    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.423627 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.423548    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:47:17.424217 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.424201    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:47:17.424296 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.424227    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:47:17.424296 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.424240    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID"
May 26 19:47:17.434189 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.434168    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.446165 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.446147    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal"
May 26 19:47:17.450723 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.450699    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal"
May 26 19:47:17.534580 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.534545    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.547844 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.547813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.547973 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.547852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.547973 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.547884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c79021a0492f565e688380e70be739c1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"c79021a0492f565e688380e70be739c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.634941 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.634908    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.648244 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648220    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.648244 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648177    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.648394 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648295    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.648394 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648346    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c79021a0492f565e688380e70be739c1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"c79021a0492f565e688380e70be739c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.648394 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648369    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddcddea90849986fae6baeeb77b7c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"2ddcddea90849986fae6baeeb77b7c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.648500 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.648398    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c79021a0492f565e688380e70be739c1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"c79021a0492f565e688380e70be739c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.735697 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.735630    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.751095 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.751068    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.754811 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:17.754794    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:17.836588 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.836551    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:17.937065 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:17.937033    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.037582 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.037498    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.138028 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.137996    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.139103 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.139083    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 19:47:18.139264 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.139242    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:47:18.238407 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.238368    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.246198 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.246172    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 19:47:18.262429 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.262393    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:47:18.262429 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.262394    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:42:17 +0000 UTC" deadline="2028-01-18 00:53:15.925885431 +0000 UTC"
May 26 19:47:18.262429 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.262430    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14429h5m57.663459189s"
May 26 19:47:18.295648 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:18.295578    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79021a0492f565e688380e70be739c1.slice/crio-19b5e528832dcfe634aae1a5e3218e85e9f012ace05aeefc0a85b63504e245fb WatchSource:0}: Error finding container 19b5e528832dcfe634aae1a5e3218e85e9f012ace05aeefc0a85b63504e245fb: Status 404 returned error can't find the container with id 19b5e528832dcfe634aae1a5e3218e85e9f012ace05aeefc0a85b63504e245fb
May 26 19:47:18.295824 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:18.295809    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddcddea90849986fae6baeeb77b7c1c.slice/crio-e211cbaea735b11ba44d9eb3ed7b1a34dfe886bcc9a2f296bdd9516507f00b6e WatchSource:0}: Error finding container e211cbaea735b11ba44d9eb3ed7b1a34dfe886bcc9a2f296bdd9516507f00b6e: Status 404 returned error can't find the container with id e211cbaea735b11ba44d9eb3ed7b1a34dfe886bcc9a2f296bdd9516507f00b6e
May 26 19:47:18.299392 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.299373    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:47:18.318289 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.318242    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"c79021a0492f565e688380e70be739c1","Type":"ContainerStarted","Data":"19b5e528832dcfe634aae1a5e3218e85e9f012ace05aeefc0a85b63504e245fb"}
May 26 19:47:18.319237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.319217    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"2ddcddea90849986fae6baeeb77b7c1c","Type":"ContainerStarted","Data":"e211cbaea735b11ba44d9eb3ed7b1a34dfe886bcc9a2f296bdd9516507f00b6e"}
May 26 19:47:18.329730 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.329711    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdksv"
May 26 19:47:18.338831 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.338804    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.343794 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.343781    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdksv"
May 26 19:47:18.382113 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.382081    2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:47:18.439499 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.439463    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.539976 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.539946    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.584130 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.584067    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:47:18.641096 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.641063    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.741997 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:18.741958    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found"
May 26 19:47:18.799023 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.798992    2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:47:18.847347 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.847265    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"
May 26 19:47:18.858647 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.858626    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:47:18.859858 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.859845    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal"
May 26 19:47:18.872499 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:18.872480    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:47:19.100646 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.100564    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:47:19.218775 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.218746    2573 apiserver.go:52] "Watching apiserver"
May 26 19:47:19.225747 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.225725    2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 19:47:19.226109 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.226086    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-748lq","openshift-dns/node-resolver-srzdg","openshift-image-registry/node-ca-k8t95","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-ncsts","openshift-multus/multus-n4j9m","openshift-multus/network-metrics-daemon-dmt5b","kube-system/konnectivity-agent-hsnfw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2","openshift-network-diagnostics/network-check-target-89pjd","openshift-network-operator/iptables-alerter-bcbhx","openshift-ovn-kubernetes/ovnkube-node-h4kwm","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"]
May 26 19:47:19.230685 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.230649    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:19.230816 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.230739    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.230816 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.230740    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:19.232926 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.232880    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.233389 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.233363    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 19:47:19.233484 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.233416    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 19:47:19.233484 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.233446    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mq2l5\""
May 26 19:47:19.235116 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.235011    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.235232 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.235190    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 19:47:19.235362 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.235314    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 19:47:19.235583 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.235544    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hxgl2\""
May 26 19:47:19.237176 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237146    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 19:47:19.237463 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237445    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 19:47:19.237854 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237835    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wckkm\""
May 26 19:47:19.237854 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237845    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 19:47:19.237992 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237841    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 19:47:19.237992 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.237926    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 19:47:19.238123 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.238107    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 19:47:19.240452 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.240431    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.240561 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.240451    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.240619 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.240561    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:19.242638 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.242619    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.242747 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.242725    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wwhxm\""
May 26 19:47:19.242804 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.242748    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 19:47:19.245100 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.244828    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 19:47:19.245100 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.245048    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.245834 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.245814    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 19:47:19.245924 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.245890    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qv4kl\""
May 26 19:47:19.247911 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.247875    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.248160 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.248142    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q8ldf\""
May 26 19:47:19.250341 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.249835    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 19:47:19.250341 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.250119    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 19:47:19.250341 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.250212    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 19:47:19.250529 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.250394    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hx627\""
May 26 19:47:19.250584 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.250548    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 19:47:19.251547 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.251526    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 19:47:19.251760 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.251614    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.254080 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.254047    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.254200 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.254144    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 19:47:19.254200 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.254156    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gqwx\""
May 26 19:47:19.254200 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.254176    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 19:47:19.254447 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.254404    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 19:47:19.255563 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-kubernetes\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.255563 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.255691 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjv7f\" (UniqueName: \"kubernetes.io/projected/5b3187e4-8f34-4897-afed-a301316418dd-kube-api-access-hjv7f\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.255691 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-host\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.255691 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-netns\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.255691 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-bin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.255691 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-modprobe-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-tmp\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-system-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255753    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-kubelet\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/666d711f-a243-4c7c-92db-4755fd228618-konnectivity-ca\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.255890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-lib-modules\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256145 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-tuned\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256145 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.255937    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:19.256145 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-registration-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.256145 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6pv7\" (UniqueName: \"kubernetes.io/projected/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-kube-api-access-b6pv7\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-systemd\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-conf\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-run\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-host\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.256342 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t65gc\" (UniqueName: \"kubernetes.io/projected/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-kube-api-access-t65gc\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cnibin\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-cnibin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-os-release\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-system-cni-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-os-release\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-socket-dir-parent\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-hostroot\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256761    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-etc-kubernetes\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256802    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256804    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-socket-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256815    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-tmp-dir\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-multus\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-multus-daemon-config\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.256940 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-var-lib-kubelet\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.256981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqqj\" (UniqueName: \"kubernetes.io/projected/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-kube-api-access-lfqqj\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-serviceca\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/666d711f-a243-4c7c-92db-4755fd228618-agent-certs\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-device-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-sys-fs\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-k8s-cni-cncf-io\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-multus-certs\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysconfig\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-conf-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-sys\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtpz\" (UniqueName: \"kubernetes.io/projected/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-kube-api-access-fxtpz\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-hosts-file\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.257454 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thj5z\" (UniqueName: \"kubernetes.io/projected/cfeecbfd-f4ab-49a3-b56a-0807652fe579-kube-api-access-thj5z\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-cni-binary-copy\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcjsd\" (UniqueName: \"kubernetes.io/projected/36310e62-1a62-4017-ac21-832155523b06-kube-api-access-bcjsd\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257781    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257823    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257835    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9bqtw\""
May 26 19:47:19.258117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.257782    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 19:47:19.345184 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.344879    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:42:18 +0000 UTC" deadline="2027-12-01 18:29:15.012688442 +0000 UTC"
May 26 19:47:19.345440 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.345411    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13294h41m55.667287408s"
May 26 19:47:19.349230 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.349205    2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 19:47:19.357932 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357864    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.357932 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357900    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-cnibin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357930    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-os-release\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357958    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-system-cni-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357975    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-os-release\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.357990    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-socket-dir-parent\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358006    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-hostroot\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358026    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-etc-kubernetes\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358053    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-socket-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358081    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-kubelet\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.358114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358106    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-tmp-dir\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358135    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-multus\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358154    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-multus-daemon-config\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358169    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358194    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-var-lib-kubelet\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358219    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqqj\" (UniqueName: \"kubernetes.io/projected/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-kube-api-access-lfqqj\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-ovn\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-netd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358273    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-serviceca\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc49280-8521-4937-b12f-5cc29aead561-ovn-node-metrics-cert\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzl7r\" (UniqueName: \"kubernetes.io/projected/4fc49280-8521-4937-b12f-5cc29aead561-kube-api-access-jzl7r\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-host-slash\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358372    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-system-cni-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-os-release\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358396    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/666d711f-a243-4c7c-92db-4755fd228618-agent-certs\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358411    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-socket-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358452    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-cnibin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.358553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-socket-dir-parent\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-os-release\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358503    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-hostroot\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358506    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-device-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358530    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-etc-kubernetes\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358545    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-device-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358549    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-sys-fs\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358578    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-k8s-cni-cncf-io\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358605    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-multus-certs\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358632    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysconfig\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-etc-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358687    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-conf-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358713    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-sys\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358729    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358738    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtpz\" (UniqueName: \"kubernetes.io/projected/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-kube-api-access-fxtpz\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358790    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-hosts-file\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.359378 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358797    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-tmp-dir\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358815    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-bin\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358903    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358934    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thj5z\" (UniqueName: \"kubernetes.io/projected/cfeecbfd-f4ab-49a3-b56a-0807652fe579-kube-api-access-thj5z\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358968    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-cni-binary-copy\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358980    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-var-lib-kubelet\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.358993    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcjsd\" (UniqueName: \"kubernetes.io/projected/36310e62-1a62-4017-ac21-832155523b06-kube-api-access-bcjsd\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359061    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-serviceca\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359191    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-sys-fs\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-k8s-cni-cncf-io\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-multus-certs\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359312    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-hosts-file\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359319    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysconfig\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359336    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-multus-daemon-config\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-systemd-units\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359395    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-multus\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359399    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-sys\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-script-lib\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359433    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-log-socket\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359493    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-kubernetes\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359514    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359565    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-conf-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359624    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359672    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjv7f\" (UniqueName: \"kubernetes.io/projected/5b3187e4-8f34-4897-afed-a301316418dd-kube-api-access-hjv7f\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359687    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-kubernetes\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359697    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-host\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359723    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-netns\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359768    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-host\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-run-netns\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359809    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-bin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.360877 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359868    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36310e62-1a62-4017-ac21-832155523b06-cni-binary-copy\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359911    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-modprobe-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359920    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-cni-bin\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.359939    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-tmp\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-slash\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360007    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-modprobe-d\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360052    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-system-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360077    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-kubelet\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360102    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-system-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-netns\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360132    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-host-var-lib-kubelet\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-env-overrides\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.360196    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360196    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/666d711f-a243-4c7c-92db-4755fd228618-konnectivity-ca\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.360260    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:19.860239353 +0000 UTC m=+3.113311341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:19.361631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360290    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-lib-modules\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360316    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-tuned\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360375    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360412    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-registration-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360429    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-lib-modules\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-var-lib-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-config\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360491    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3187e4-8f34-4897-afed-a301316418dd-registration-dir\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt4b4\" (UniqueName: \"kubernetes.io/projected/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-kube-api-access-xt4b4\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360535    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6pv7\" (UniqueName: \"kubernetes.io/projected/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-kube-api-access-b6pv7\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360561    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-systemd\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360587    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360614    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-conf\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360636    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-run\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360641    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-systemd\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360656    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-host\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-systemd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.362282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-node-log\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-iptables-alerter-script\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360746    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-host\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360773    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t65gc\" (UniqueName: \"kubernetes.io/projected/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-kube-api-access-t65gc\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360784    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36310e62-1a62-4017-ac21-832155523b06-multus-cni-dir\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360799    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cnibin\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360832    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360833    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-run\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360878    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.360898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-sysctl-conf\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.361363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-binary-copy\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.361373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/666d711f-a243-4c7c-92db-4755fd228618-konnectivity-ca\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.361491    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.361535    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfeecbfd-f4ab-49a3-b56a-0807652fe579-cnibin\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.362558    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-tmp\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.362615    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-etc-tuned\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.362982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.362790    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/666d711f-a243-4c7c-92db-4755fd228618-agent-certs\") pod \"konnectivity-agent-hsnfw\" (UID: \"666d711f-a243-4c7c-92db-4755fd228618\") " pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.366540 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.366505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqqj\" (UniqueName: \"kubernetes.io/projected/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-kube-api-access-lfqqj\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.366894 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.366875    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcjsd\" (UniqueName: \"kubernetes.io/projected/36310e62-1a62-4017-ac21-832155523b06-kube-api-access-bcjsd\") pod \"multus-n4j9m\" (UID: \"36310e62-1a62-4017-ac21-832155523b06\") " pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.369995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.369967    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtpz\" (UniqueName: \"kubernetes.io/projected/3c138f39-9a20-468b-b9d8-4f35f1e3bfc9-kube-api-access-fxtpz\") pod \"tuned-748lq\" (UID: \"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9\") " pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.371782 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.371764    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:19.371924 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.371910    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:19.372032 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.372020    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:19.372198 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.372185    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:19.872164315 +0000 UTC m=+3.125236288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:19.373585 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.373539    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjv7f\" (UniqueName: \"kubernetes.io/projected/5b3187e4-8f34-4897-afed-a301316418dd-kube-api-access-hjv7f\") pod \"aws-ebs-csi-driver-node-nbgn2\" (UID: \"5b3187e4-8f34-4897-afed-a301316418dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.374354 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.374287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6pv7\" (UniqueName: \"kubernetes.io/projected/9f94ddcb-68c9-4425-acfc-46ff8a3c55c5-kube-api-access-b6pv7\") pod \"node-ca-k8t95\" (UID: \"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5\") " pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.374572 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.374550    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thj5z\" (UniqueName: \"kubernetes.io/projected/cfeecbfd-f4ab-49a3-b56a-0807652fe579-kube-api-access-thj5z\") pod \"multus-additional-cni-plugins-ncsts\" (UID: \"cfeecbfd-f4ab-49a3-b56a-0807652fe579\") " pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.374686 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.374661    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t65gc\" (UniqueName: \"kubernetes.io/projected/86d43817-1b3e-4e9e-a80f-13fdc2301ff2-kube-api-access-t65gc\") pod \"node-resolver-srzdg\" (UID: \"86d43817-1b3e-4e9e-a80f-13fdc2301ff2\") " pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.461231 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461189    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461244    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461272    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-bin\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461302    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-systemd-units\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461301    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461341    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-script-lib\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-bin\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461396    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-systemd-units\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461416 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461395    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-log-socket\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461435    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-log-socket\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461475    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-slash\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461447    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-slash\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461514    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461548    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-netns\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461563    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-env-overrides\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461592    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-var-lib-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461619    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-config\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461645    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xt4b4\" (UniqueName: \"kubernetes.io/projected/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-kube-api-access-xt4b4\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461651    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-run-netns\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461676    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-systemd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461703    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-node-log\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-systemd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461752    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-iptables-alerter-script\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.461793 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-node-log\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461822    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-kubelet\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461856    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-ovn\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461883    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-netd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461909    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc49280-8521-4937-b12f-5cc29aead561-ovn-node-metrics-cert\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461962    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzl7r\" (UniqueName: \"kubernetes.io/projected/4fc49280-8521-4937-b12f-5cc29aead561-kube-api-access-jzl7r\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461988    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-host-slash\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.461715    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-var-lib-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462036    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-etc-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462056    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-env-overrides\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462083    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-cni-netd\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462116    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-host-kubelet\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462124    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-etc-openvswitch\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462158    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fc49280-8521-4937-b12f-5cc29aead561-run-ovn\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-host-slash\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.462621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-iptables-alerter-script\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.463148 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462812    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-script-lib\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.463148 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.462882    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fc49280-8521-4937-b12f-5cc29aead561-ovnkube-config\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.464696 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.464671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fc49280-8521-4937-b12f-5cc29aead561-ovn-node-metrics-cert\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.470156 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.470132    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt4b4\" (UniqueName: \"kubernetes.io/projected/cd1f2ec3-be18-400b-9d67-9680dd1ab6dc-kube-api-access-xt4b4\") pod \"iptables-alerter-bcbhx\" (UID: \"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc\") " pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.470281 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.470142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzl7r\" (UniqueName: \"kubernetes.io/projected/4fc49280-8521-4937-b12f-5cc29aead561-kube-api-access-jzl7r\") pod \"ovnkube-node-h4kwm\" (UID: \"4fc49280-8521-4937-b12f-5cc29aead561\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.543096 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.543059    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-srzdg"
May 26 19:47:19.551993 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.551958    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8t95"
May 26 19:47:19.561677 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.561644    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ncsts"
May 26 19:47:19.566371 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.566351    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n4j9m"
May 26 19:47:19.573889 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.573865    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:19.580487 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.580462    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2"
May 26 19:47:19.587136 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.587117    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-748lq"
May 26 19:47:19.593724 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.593693    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bcbhx"
May 26 19:47:19.599400 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.599376    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:19.673254 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.673220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfeecbfd_f4ab_49a3_b56a_0807652fe579.slice/crio-2c7a74b64b53588a41b52219512b1dcc1bb5c9eb6fc9fd1dfc894acbac6a55fd WatchSource:0}: Error finding container 2c7a74b64b53588a41b52219512b1dcc1bb5c9eb6fc9fd1dfc894acbac6a55fd: Status 404 returned error can't find the container with id 2c7a74b64b53588a41b52219512b1dcc1bb5c9eb6fc9fd1dfc894acbac6a55fd
May 26 19:47:19.673976 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.673951    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36310e62_1a62_4017_ac21_832155523b06.slice/crio-06f9cedf020b720f65fc7d7e338f8d99da0819642975757d70eec32c6c1c9720 WatchSource:0}: Error finding container 06f9cedf020b720f65fc7d7e338f8d99da0819642975757d70eec32c6c1c9720: Status 404 returned error can't find the container with id 06f9cedf020b720f65fc7d7e338f8d99da0819642975757d70eec32c6c1c9720
May 26 19:47:19.678105 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.678082    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc49280_8521_4937_b12f_5cc29aead561.slice/crio-578b8d1f802072e9a3263f00178e12db97998c301df4790626758bea0b5896f2 WatchSource:0}: Error finding container 578b8d1f802072e9a3263f00178e12db97998c301df4790626758bea0b5896f2: Status 404 returned error can't find the container with id 578b8d1f802072e9a3263f00178e12db97998c301df4790626758bea0b5896f2
May 26 19:47:19.679640 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.679612    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1f2ec3_be18_400b_9d67_9680dd1ab6dc.slice/crio-39db65ac358c9048612612683cbeff9185ea783cda5a77487f92aed312fd5eb9 WatchSource:0}: Error finding container 39db65ac358c9048612612683cbeff9185ea783cda5a77487f92aed312fd5eb9: Status 404 returned error can't find the container with id 39db65ac358c9048612612683cbeff9185ea783cda5a77487f92aed312fd5eb9
May 26 19:47:19.680302 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.680274    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3187e4_8f34_4897_afed_a301316418dd.slice/crio-f90c5753d18d7fe3bd855d772de2058b54b1f67dc27b4f7128fc363468f15e11 WatchSource:0}: Error finding container f90c5753d18d7fe3bd855d772de2058b54b1f67dc27b4f7128fc363468f15e11: Status 404 returned error can't find the container with id f90c5753d18d7fe3bd855d772de2058b54b1f67dc27b4f7128fc363468f15e11
May 26 19:47:19.681407 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.681281    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f94ddcb_68c9_4425_acfc_46ff8a3c55c5.slice/crio-03512477e1d16067438cc1ff456f86490a9c2f01774acfd7be82307f74c07fe4 WatchSource:0}: Error finding container 03512477e1d16067438cc1ff456f86490a9c2f01774acfd7be82307f74c07fe4: Status 404 returned error can't find the container with id 03512477e1d16067438cc1ff456f86490a9c2f01774acfd7be82307f74c07fe4
May 26 19:47:19.683084 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.682973    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d43817_1b3e_4e9e_a80f_13fdc2301ff2.slice/crio-8441f84e09aa5982c9b30adfb73f98f48f02a4ab3237fc0633aebf5663b3d39f WatchSource:0}: Error finding container 8441f84e09aa5982c9b30adfb73f98f48f02a4ab3237fc0633aebf5663b3d39f: Status 404 returned error can't find the container with id 8441f84e09aa5982c9b30adfb73f98f48f02a4ab3237fc0633aebf5663b3d39f
May 26 19:47:19.684135 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.684097    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666d711f_a243_4c7c_92db_4755fd228618.slice/crio-73ec21f9ac1d772bb7e2a4b365729f79604470d9612dfa0948e6cb594b71a039 WatchSource:0}: Error finding container 73ec21f9ac1d772bb7e2a4b365729f79604470d9612dfa0948e6cb594b71a039: Status 404 returned error can't find the container with id 73ec21f9ac1d772bb7e2a4b365729f79604470d9612dfa0948e6cb594b71a039
May 26 19:47:19.684510 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:19.684482    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c138f39_9a20_468b_b9d8_4f35f1e3bfc9.slice/crio-f1d24d36811a6b3371202c58eb98cef1c3b28848c954b0c945a51d1d08c96613 WatchSource:0}: Error finding container f1d24d36811a6b3371202c58eb98cef1c3b28848c954b0c945a51d1d08c96613: Status 404 returned error can't find the container with id f1d24d36811a6b3371202c58eb98cef1c3b28848c954b0c945a51d1d08c96613
May 26 19:47:19.865771 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.865729    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:19.865927 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.865869    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:19.865971 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.865932    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:20.865916607 +0000 UTC m=+4.118988581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:19.966631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:19.966390    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:19.966631 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.966543    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:19.966631 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.966614    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:19.966631 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.966629    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:19.966930 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:19.966690    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:20.966672811 +0000 UTC m=+4.219744780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:20.335758 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.334846    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"c79021a0492f565e688380e70be739c1","Type":"ContainerStarted","Data":"a4b504427e9117f2fee578ad0b2bf0450a278f0ba7b2671818c5c06d6c7a5e5c"}
May 26 19:47:20.346633 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.346571    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:42:18 +0000 UTC" deadline="2028-03-10 05:00:55.24958 +0000 UTC"
May 26 19:47:20.346633 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.346631    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15681h13m34.902953048s"
May 26 19:47:20.354268 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.354230    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-748lq" event={"ID":"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9","Type":"ContainerStarted","Data":"f1d24d36811a6b3371202c58eb98cef1c3b28848c954b0c945a51d1d08c96613"}
May 26 19:47:20.361196 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.361160    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8t95" event={"ID":"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5","Type":"ContainerStarted","Data":"03512477e1d16067438cc1ff456f86490a9c2f01774acfd7be82307f74c07fe4"}
May 26 19:47:20.368438 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.368368    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2" event={"ID":"5b3187e4-8f34-4897-afed-a301316418dd","Type":"ContainerStarted","Data":"f90c5753d18d7fe3bd855d772de2058b54b1f67dc27b4f7128fc363468f15e11"}
May 26 19:47:20.372025 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.371993    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerStarted","Data":"2c7a74b64b53588a41b52219512b1dcc1bb5c9eb6fc9fd1dfc894acbac6a55fd"}
May 26 19:47:20.375726 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.375682    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hsnfw" event={"ID":"666d711f-a243-4c7c-92db-4755fd228618","Type":"ContainerStarted","Data":"73ec21f9ac1d772bb7e2a4b365729f79604470d9612dfa0948e6cb594b71a039"}
May 26 19:47:20.377742 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.377634    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-srzdg" event={"ID":"86d43817-1b3e-4e9e-a80f-13fdc2301ff2","Type":"ContainerStarted","Data":"8441f84e09aa5982c9b30adfb73f98f48f02a4ab3237fc0633aebf5663b3d39f"}
May 26 19:47:20.384444 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.384385    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bcbhx" event={"ID":"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc","Type":"ContainerStarted","Data":"39db65ac358c9048612612683cbeff9185ea783cda5a77487f92aed312fd5eb9"}
May 26 19:47:20.390067 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.389986    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"578b8d1f802072e9a3263f00178e12db97998c301df4790626758bea0b5896f2"}
May 26 19:47:20.394593 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.394544    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n4j9m" event={"ID":"36310e62-1a62-4017-ac21-832155523b06","Type":"ContainerStarted","Data":"06f9cedf020b720f65fc7d7e338f8d99da0819642975757d70eec32c6c1c9720"}
May 26 19:47:20.872592 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.872552    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:20.872816 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.872729    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:20.872901 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.872816    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:22.872784738 +0000 UTC m=+6.125856723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:20.974439 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:20.973768    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:20.974439 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.973960    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:20.974439 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.973980    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:20.974439 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.973993    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:20.974439 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:20.974056    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:22.974035958 +0000 UTC m=+6.227107946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:21.316956 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:21.316175    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:21.316956 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:21.316305    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:21.316956 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:21.316742    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:21.316956 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:21.316873    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:22.891167 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:22.891039    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:22.891630 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.891218    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:22.891630 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.891299    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:26.891277929 +0000 UTC m=+10.144349911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:22.991669 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:22.991622    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:22.991858 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.991805    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:22.991858 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.991831    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:22.991858 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.991849    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:22.992024 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:22.991930    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:26.991911322 +0000 UTC m=+10.244983308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:23.316310 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:23.316225    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:23.316501 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:23.316379    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:23.318470 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:23.318248    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:23.318470 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:23.318417    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:24.852831 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.852762    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" podStartSLOduration=6.852739362 podStartE2EDuration="6.852739362s" podCreationTimestamp="2026-05-26 19:47:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:47:20.349146602 +0000 UTC m=+3.602218593" watchObservedRunningTime="2026-05-26 19:47:24.852739362 +0000 UTC m=+8.105811354"
May 26 19:47:24.854711 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.853933    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cbmjp"]
May 26 19:47:24.860225 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.860196    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:24.860415 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:24.860297    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:24.910074 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.910025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-kubelet-config\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:24.910255 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.910086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:24.910255 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:24.910179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-dbus\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.011014    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.011099    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-dbus\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.011147    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-kubelet-config\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.011220    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.011242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-kubelet-config\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.011281    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:25.511266213 +0000 UTC m=+8.764338182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:25.011460 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.011404    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4c607f4-ca87-49a5-b2f7-617adc43670f-dbus\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.316667 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.315596    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:25.316667 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.315734    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:25.316667 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.316285    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:25.316667 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.316444    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:25.516085 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:25.516043    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:25.516252 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.516194    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:25.516313 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:25.516267    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:26.516247641 +0000 UTC m=+9.769319628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:26.315448 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:26.315409    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:26.315916 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:26.315555    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:26.525587 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:26.525538    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:26.525764 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:26.525748    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:26.525822 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:26.525816    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:28.525796793 +0000 UTC m=+11.778868764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:26.929175 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:26.928612    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:26.929175 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:26.928777    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:26.929175 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:26.928841    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:34.92882364 +0000 UTC m=+18.181895613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:27.029801 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:27.029759    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:27.029986 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.029969    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:27.030043 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.029992    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:27.030043 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.030006    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:27.030155 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.030074    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:35.030054089 +0000 UTC m=+18.283126060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:27.316756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:27.316199    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:27.316756 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.316315    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:27.316756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:27.316370    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:27.316756 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:27.316497    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:28.315887 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:28.315797    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:28.316048 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:28.315978    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:28.543430 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:28.543385    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:28.543893 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:28.543554    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:28.543893 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:28.543632    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:32.543612141 +0000 UTC m=+15.796684124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:29.315869 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:29.315831    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:29.316063 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:29.315831    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:29.316063 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:29.315968    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:29.316063 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:29.316017    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:30.315659 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:30.315623    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:30.316097 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:30.315802    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:31.315665 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:31.315627    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:31.315850 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:31.315757    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:31.315850 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:31.315832    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:31.316243 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:31.315972    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:32.315538 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:32.315505    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:32.315738 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:32.315607    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:32.571384 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:32.571291    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:32.571769 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:32.571441    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:32.571769 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:32.571515    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:40.571497898 +0000 UTC m=+23.824569881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:33.316106 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:33.316070    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:33.316303 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:33.316113    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:33.316303 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:33.316210    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:33.316502 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:33.316323    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:34.316268 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:34.316184    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:34.316763 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:34.316319    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:34.989671 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:34.989627    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:34.989868 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:34.989820    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:34.989938 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:34.989908    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:50.989883433 +0000 UTC m=+34.242955405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:35.090321 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:35.090286    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:35.090509 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.090443    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:35.090509 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.090463    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:35.090509 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.090474    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:35.090630 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.090526    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:51.090512428 +0000 UTC m=+34.343584415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:35.316199 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:35.316105    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:35.316199 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:35.316157    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:35.316736 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.316251    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:35.316736 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:35.316436    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:36.316004 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:36.315962    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:36.316205 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:36.316105    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:37.316666 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:37.316635    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:37.317076 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:37.316750    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:37.317076 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:37.316832    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:37.317076 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:37.316928    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:38.315371 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:38.315345    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:38.315531 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:38.315481    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:39.315964 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.315723    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:39.316592 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.315729    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:39.316592 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:39.316078    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:39.316592 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:39.316180    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:39.435012 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.434983    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hsnfw" event={"ID":"666d711f-a243-4c7c-92db-4755fd228618","Type":"ContainerStarted","Data":"87c95978bbb2ea90682dca5b948ba1770f2bdfad5da9a5873cc7045c17db7f69"}
May 26 19:47:39.436222 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.436192    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-srzdg" event={"ID":"86d43817-1b3e-4e9e-a80f-13fdc2301ff2","Type":"ContainerStarted","Data":"5925b14c667aa5f8dd9f9eb0bf71f4c8259cc77cbbd278f8ea383430ec700f5b"}
May 26 19:47:39.438050 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.438026    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"1f3eec8af2c938cd41baab7d06ec9862aa96fcc8c4aad2d1759f785a35c112f3"}
May 26 19:47:39.438237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.438057    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"0e903c2ee14beed3bb3d4e6fbb995ac01716224df1a9e7a395e5c29007a72952"}
May 26 19:47:39.438237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.438070    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"7955014a8de658df3cfc6974957f69865dfa931edcbed0b9188cb54f0a61a593"}
May 26 19:47:39.438237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.438078    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"f5b238d9b5d78e7090da7d577f957df01ecf1cd0e44b46cfa91116281fcfcd16"}
May 26 19:47:39.439183 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.439160    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n4j9m" event={"ID":"36310e62-1a62-4017-ac21-832155523b06","Type":"ContainerStarted","Data":"b5a1cb72b052addc6335e7b7b66ca2f24937381f401b53eedb34432ad34a2f1f"}
May 26 19:47:39.440417 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.440395    2573 generic.go:358] "Generic (PLEG): container finished" podID="2ddcddea90849986fae6baeeb77b7c1c" containerID="1e8da489c6d715cc7602a04a8423990cd0a66411aafa7a375f04857edb461ee3" exitCode=0
May 26 19:47:39.440500 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.440451    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"2ddcddea90849986fae6baeeb77b7c1c","Type":"ContainerDied","Data":"1e8da489c6d715cc7602a04a8423990cd0a66411aafa7a375f04857edb461ee3"}
May 26 19:47:39.441734 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.441715    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-748lq" event={"ID":"3c138f39-9a20-468b-b9d8-4f35f1e3bfc9","Type":"ContainerStarted","Data":"c915da4c997cf210a01a05ec78e5b85a358232d352a54ed344b3ec1ce0dc5147"}
May 26 19:47:39.442976 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.442956    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8t95" event={"ID":"9f94ddcb-68c9-4425-acfc-46ff8a3c55c5","Type":"ContainerStarted","Data":"3669c90bd9faf7cc6fe841585ea4d89641fd94ccf7ce5b0130263316c9fc3f9a"}
May 26 19:47:39.444092 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.444065    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2" event={"ID":"5b3187e4-8f34-4897-afed-a301316418dd","Type":"ContainerStarted","Data":"7ca0af6e11597fddb231869aed91c651c2d20bbd7f05e68c11a4bd6e6bf4c59c"}
May 26 19:47:39.445181 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.445161    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="8afff49705957e193320094a0df4f91c3741ca9dca085dcf03f026117ee98e5a" exitCode=0
May 26 19:47:39.445261 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.445193    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"8afff49705957e193320094a0df4f91c3741ca9dca085dcf03f026117ee98e5a"}
May 26 19:47:39.462606 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.462566    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hsnfw" podStartSLOduration=3.846462345 podStartE2EDuration="22.462552948s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.707834581 +0000 UTC m=+2.960906565" lastFinishedPulling="2026-05-26 19:47:38.323925197 +0000 UTC m=+21.576997168" observedRunningTime="2026-05-26 19:47:39.462344241 +0000 UTC m=+22.715416228" watchObservedRunningTime="2026-05-26 19:47:39.462552948 +0000 UTC m=+22.715624939"
May 26 19:47:39.477372 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.477306    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-srzdg" podStartSLOduration=3.835764547 podStartE2EDuration="22.477293005s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.707709764 +0000 UTC m=+2.960781734" lastFinishedPulling="2026-05-26 19:47:38.349238223 +0000 UTC m=+21.602310192" observedRunningTime="2026-05-26 19:47:39.477205371 +0000 UTC m=+22.730277364" watchObservedRunningTime="2026-05-26 19:47:39.477293005 +0000 UTC m=+22.730364995"
May 26 19:47:39.491846 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.491803    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k8t95" podStartSLOduration=3.898329062 podStartE2EDuration="22.491787594s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.683301531 +0000 UTC m=+2.936373511" lastFinishedPulling="2026-05-26 19:47:38.276760057 +0000 UTC m=+21.529832043" observedRunningTime="2026-05-26 19:47:39.491369118 +0000 UTC m=+22.744441106" watchObservedRunningTime="2026-05-26 19:47:39.491787594 +0000 UTC m=+22.744859609"
May 26 19:47:39.512189 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.512015    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n4j9m" podStartSLOduration=3.833611978 podStartE2EDuration="22.511997336s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.676980834 +0000 UTC m=+2.930052803" lastFinishedPulling="2026-05-26 19:47:38.35536618 +0000 UTC m=+21.608438161" observedRunningTime="2026-05-26 19:47:39.511719499 +0000 UTC m=+22.764791492" watchObservedRunningTime="2026-05-26 19:47:39.511997336 +0000 UTC m=+22.765069328"
May 26 19:47:39.573957 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:39.573918    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-748lq" podStartSLOduration=3.936333005 podStartE2EDuration="22.573904227s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.707619234 +0000 UTC m=+2.960691224" lastFinishedPulling="2026-05-26 19:47:38.34519047 +0000 UTC m=+21.598262446" observedRunningTime="2026-05-26 19:47:39.573887744 +0000 UTC m=+22.826959735" watchObservedRunningTime="2026-05-26 19:47:39.573904227 +0000 UTC m=+22.826976217"
May 26 19:47:40.315486 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.315459    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:40.315672 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:40.315573    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:40.364242 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.364217    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 19:47:40.448121 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.448082    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bcbhx" event={"ID":"cd1f2ec3-be18-400b-9d67-9680dd1ab6dc","Type":"ContainerStarted","Data":"553852cb51a0c2a08eb17069adf5239efaf8fe7461a030d64bcc897685185f3e"}
May 26 19:47:40.450584 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.450561    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"beb48695859cf36cd3bf81c72b222cbaa6178b9376904ae75d4bd26c9c15d8dd"}
May 26 19:47:40.450697 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.450592    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"363155fdf31f1ad53f1cab89f54c5f65538adbb730a4d59c07ae96ab3fc6a80b"}
May 26 19:47:40.451981 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.451956    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"2ddcddea90849986fae6baeeb77b7c1c","Type":"ContainerStarted","Data":"328f89dcc5c9d986d38169a3145d5f1b63b09ddffb24bd235b7017854322ec83"}
May 26 19:47:40.453633 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.453604    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2" event={"ID":"5b3187e4-8f34-4897-afed-a301316418dd","Type":"ContainerStarted","Data":"dfdb6a5882ee60b1d64389189c99ed082abbd12002cfacbc5d489bd9e9482e54"}
May 26 19:47:40.462297 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.462245    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bcbhx" podStartSLOduration=9.21114207 podStartE2EDuration="23.462231677s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.681966828 +0000 UTC m=+2.935038802" lastFinishedPulling="2026-05-26 19:47:33.933056426 +0000 UTC m=+17.186128409" observedRunningTime="2026-05-26 19:47:40.462038711 +0000 UTC m=+23.715110703" watchObservedRunningTime="2026-05-26 19:47:40.462231677 +0000 UTC m=+23.715303669"
May 26 19:47:40.477167 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.477113    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" podStartSLOduration=22.477096851 podStartE2EDuration="22.477096851s" podCreationTimestamp="2026-05-26 19:47:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:47:40.476866295 +0000 UTC m=+23.729938291" watchObservedRunningTime="2026-05-26 19:47:40.477096851 +0000 UTC m=+23.730168843"
May 26 19:47:40.629828 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:40.629739    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:40.629989 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:40.629908    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:47:40.630052 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:40.630010    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret podName:f4c607f4-ca87-49a5-b2f7-617adc43670f nodeName:}" failed. No retries permitted until 2026-05-26 19:47:56.629988782 +0000 UTC m=+39.883060771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret") pod "global-pull-secret-syncer-cbmjp" (UID: "f4c607f4-ca87-49a5-b2f7-617adc43670f") : object "kube-system"/"original-pull-secret" not registered
May 26 19:47:41.316021 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:41.315980    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:41.316021 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:41.316013    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:41.316280 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:41.316108    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:41.316356 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:41.316285    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:41.323925 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:41.323822    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:47:40.364239688Z","UUID":"013f8742-44f9-455a-be37-6a4161d854a1","Handler":null,"Name":"","Endpoint":""}
May 26 19:47:41.326476 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:41.326453    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 19:47:41.326609 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:41.326486    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 19:47:42.316207 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:42.316177    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:42.316722 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:42.316311    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:42.461557 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:42.461512    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"113ced8b94ff16c29dfcbb8fc90573f6df7e584d1aeb7a309c2e42424efd3556"}
May 26 19:47:42.463474 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:42.463446    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2" event={"ID":"5b3187e4-8f34-4897-afed-a301316418dd","Type":"ContainerStarted","Data":"83c4251d4bc0dfb09833e172f300b6af5af6cf5c05729130c895cd1ce786dd3a"}
May 26 19:47:42.481070 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:42.481001    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbgn2" podStartSLOduration=3.408347778 podStartE2EDuration="25.48098577s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.682420375 +0000 UTC m=+2.935492346" lastFinishedPulling="2026-05-26 19:47:41.755058355 +0000 UTC m=+25.008130338" observedRunningTime="2026-05-26 19:47:42.480812452 +0000 UTC m=+25.733884444" watchObservedRunningTime="2026-05-26 19:47:42.48098577 +0000 UTC m=+25.734057763"
May 26 19:47:43.315729 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:43.315692    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:43.315919 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:43.315740    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:43.315919 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:43.315836    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:43.316033 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:43.315972    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:44.100741 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.100527    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:44.101288 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.101105    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:44.315855 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.315759    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:44.316031 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:44.315880    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:44.468685 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.468643    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="4de9cdc3313f626caf8a86a3c0d281a2c5253735b903538b61f07da12f0f8c8b" exitCode=0
May 26 19:47:44.468845 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.468724    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"4de9cdc3313f626caf8a86a3c0d281a2c5253735b903538b61f07da12f0f8c8b"}
May 26 19:47:44.472096 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.472073    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" event={"ID":"4fc49280-8521-4937-b12f-5cc29aead561","Type":"ContainerStarted","Data":"ba34304a593cff037b388967d07b66b1f340e4f10cc5eb18996c33b25f09260e"}
May 26 19:47:44.472319 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.472302    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:44.472716 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.472672    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:44.472813 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.472786    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hsnfw"
May 26 19:47:44.488436 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.488408    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:44.536824 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:44.536772    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm" podStartSLOduration=8.285996432 podStartE2EDuration="27.536756037s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.679845143 +0000 UTC m=+2.932917112" lastFinishedPulling="2026-05-26 19:47:38.930604743 +0000 UTC m=+22.183676717" observedRunningTime="2026-05-26 19:47:44.536230724 +0000 UTC m=+27.789302715" watchObservedRunningTime="2026-05-26 19:47:44.536756037 +0000 UTC m=+27.789828027"
May 26 19:47:45.316262 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.316238    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:45.316723 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.316355    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:45.316723 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:45.316442    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:45.316723 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:45.316354    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:45.476754 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.476713    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerStarted","Data":"f0a5b0a401c343160898650a401fd3be44762d40cbf8d5bb09f35afbf7ec0333"}
May 26 19:47:45.477385 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.477364    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:45.477635 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.477599    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:45.492773 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.492752    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:47:45.852629 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.852592    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmt5b"]
May 26 19:47:45.852774 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.852732    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:45.852847 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:45.852827    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:45.855842 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.855813    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cbmjp"]
May 26 19:47:45.855968 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.855926    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:45.856033 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:45.856015    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:45.856575 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.856553    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-89pjd"]
May 26 19:47:45.856678 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:45.856659    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:45.856783 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:45.856761    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:46.480442 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:46.480236    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="f0a5b0a401c343160898650a401fd3be44762d40cbf8d5bb09f35afbf7ec0333" exitCode=0
May 26 19:47:46.480894 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:46.480288    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"f0a5b0a401c343160898650a401fd3be44762d40cbf8d5bb09f35afbf7ec0333"}
May 26 19:47:47.316517 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:47.316484    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:47.316710 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:47.316577    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:47.316710 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:47.316614    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:47.316710 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:47.316632    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:47.316877 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:47.316739    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:47.316877 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:47.316825    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:48.486340 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:48.486292    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="449c3eb09a33a1a5ee2d35eea0c94dc4109e2ebb2d1779469d78c32853ecd8db" exitCode=0
May 26 19:47:48.486760 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:48.486364    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"449c3eb09a33a1a5ee2d35eea0c94dc4109e2ebb2d1779469d78c32853ecd8db"}
May 26 19:47:49.315891 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:49.315836    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:49.315891 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:49.315859    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:49.316268 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:49.315835    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:49.316268 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:49.316208    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:49.316426 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:49.316376    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:49.316512 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:49.316477    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:51.012387 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.012351    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:51.012853 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.012470    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:51.012853 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.012542    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:48:23.012525189 +0000 UTC m=+66.265597158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:47:51.113616 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.113576    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:51.113809 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.113746    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:47:51.113809 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.113766    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:47:51.113809 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.113779    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7sh86 for pod openshift-network-diagnostics/network-check-target-89pjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:51.113968 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.113839    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86 podName:9ac75fb6-aedc-4ecf-99b8-6672cca54003 nodeName:}" failed. No retries permitted until 2026-05-26 19:48:23.113821522 +0000 UTC m=+66.366893497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sh86" (UniqueName: "kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86") pod "network-check-target-89pjd" (UID: "9ac75fb6-aedc-4ecf-99b8-6672cca54003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:47:51.315537 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.315458    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:51.315705 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.315468    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:51.315705 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.315581    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-89pjd" podUID="9ac75fb6-aedc-4ecf-99b8-6672cca54003"
May 26 19:47:51.315705 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.315590    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:51.315705 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.315667    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cbmjp" podUID="f4c607f4-ca87-49a5-b2f7-617adc43670f"
May 26 19:47:51.315908 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.315771    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:47:51.512728 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.512699    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeReady"
May 26 19:47:51.512981 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.512911    2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 19:47:51.545666 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.545627    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"]
May 26 19:47:51.558393 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.558363    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:47:51.558682 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.558529    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.561611 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.561444    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 19:47:51.561611 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.561457    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 19:47:51.561611 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.561489    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 19:47:51.561856 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.561647    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-br8gt\""
May 26 19:47:51.561915 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.561891    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 19:47:51.572676 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.572625    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"]
May 26 19:47:51.572848 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.572822    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.575554 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.575525    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 19:47:51.575693 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.575593    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 19:47:51.575693 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.575664    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bslzb\""
May 26 19:47:51.575890 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.575874    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 19:47:51.581776 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.581754    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 19:47:51.588924 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.588903    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"]
May 26 19:47:51.589097 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.589075    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.591651 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.591630    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 19:47:51.603377 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.603306    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lfww2"]
May 26 19:47:51.603517 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.603464    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.606000 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.605979    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 19:47:51.606382 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.606361    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 19:47:51.606550 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.606527    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 19:47:51.606550 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.606439    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 19:47:51.613555 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.613533    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"]
May 26 19:47:51.613555 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.613558    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pgkrz"]
May 26 19:47:51.613733 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.613713    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.616351 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.616251    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 19:47:51.616465 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.616356    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 19:47:51.616465 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.616422    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c99wf\""
May 26 19:47:51.625950 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.625910    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"]
May 26 19:47:51.625950 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.625956    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:47:51.626132 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.625969    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfww2"]
May 26 19:47:51.626132 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.626066    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgkrz"]
May 26 19:47:51.626132 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.626076    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.626269 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.626078    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"]
May 26 19:47:51.628824 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.628799    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rmf4h\""
May 26 19:47:51.628937 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.628876    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 19:47:51.628937 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.628884    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 19:47:51.629022 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.628799    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 19:47:51.717177 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.717177 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-tmp\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpz4g\" (UniqueName: \"kubernetes.io/projected/646c41fe-f0bf-4150-a294-fa6627c23c52-kube-api-access-dpz4g\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt8l4\" (UniqueName: \"kubernetes.io/projected/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-kube-api-access-bt8l4\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.717488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99ms\" (UniqueName: \"kubernetes.io/projected/88d3c016-26a7-4b39-a6c3-ffc80af1a582-kube-api-access-w99ms\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717513    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrnt\" (UniqueName: \"kubernetes.io/projected/68ac85af-0e48-492b-ba27-b92c551b354c-kube-api-access-gjrnt\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/646c41fe-f0bf-4150-a294-fa6627c23c52-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac85af-0e48-492b-ba27-b92c551b354c-tmp-dir\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717751    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlq9\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpxk\" (UniqueName: \"kubernetes.io/projected/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-kube-api-access-llpxk\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.717863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ac85af-0e48-492b-ba27-b92c551b354c-config-volume\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.718339 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.718339 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.718339 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.717985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.718339 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.718009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.819285 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819200    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.819285 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819255    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/646c41fe-f0bf-4150-a294-fa6627c23c52-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.819535 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819382    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac85af-0e48-492b-ba27-b92c551b354c-tmp-dir\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.819535 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819447    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.819535 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819473    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlq9\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.819535 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.819388    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:47:51.819535 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819509    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llpxk\" (UniqueName: \"kubernetes.io/projected/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-kube-api-access-llpxk\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819552    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ac85af-0e48-492b-ba27-b92c551b354c-config-volume\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.819583    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:52.319557748 +0000 UTC m=+35.572629728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.819594    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.819609    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819621    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819651    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.819659    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:47:52.319645929 +0000 UTC m=+35.572717898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819685    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ac85af-0e48-492b-ba27-b92c551b354c-tmp-dir\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819708    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.819779 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819734    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.820265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819795    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.820265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.819822    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.820265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.820265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820082    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68ac85af-0e48-492b-ba27-b92c551b354c-config-volume\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.820265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/646c41fe-f0bf-4150-a294-fa6627c23c52-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820267    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820298    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820320    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820379    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-tmp\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820404    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820435    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz4g\" (UniqueName: \"kubernetes.io/projected/646c41fe-f0bf-4150-a294-fa6627c23c52-kube-api-access-dpz4g\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820463    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt8l4\" (UniqueName: \"kubernetes.io/projected/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-kube-api-access-bt8l4\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820494    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w99ms\" (UniqueName: \"kubernetes.io/projected/88d3c016-26a7-4b39-a6c3-ffc80af1a582-kube-api-access-w99ms\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820522    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.820543 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820548    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.821022 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820578    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrnt\" (UniqueName: \"kubernetes.io/projected/68ac85af-0e48-492b-ba27-b92c551b354c-kube-api-access-gjrnt\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.821022 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.820604    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.823016 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.821554    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.823016 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.821620    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.823016 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.821848    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-tmp\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.823016 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.821938    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:47:51.823016 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:51.821984    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:47:52.321967557 +0000 UTC m=+35.575039530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:47:51.824732 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.824667    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-ca\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.824732 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.824682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.824732 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.824692    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.825124 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.825075    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.825441 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.825411    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.825600 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.825573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.825928 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.825906    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.826298 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.826282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/646c41fe-f0bf-4150-a294-fa6627c23c52-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.834960 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.834934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.836027 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.835955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlq9\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:51.836320 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.836290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt8l4\" (UniqueName: \"kubernetes.io/projected/c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39-kube-api-access-bt8l4\") pod \"klusterlet-addon-workmgr-7c6dd99c68-fdm66\" (UID: \"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.836577 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.836533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpz4g\" (UniqueName: \"kubernetes.io/projected/646c41fe-f0bf-4150-a294-fa6627c23c52-kube-api-access-dpz4g\") pod \"cluster-proxy-proxy-agent-874b58676-rfnkb\" (UID: \"646c41fe-f0bf-4150-a294-fa6627c23c52\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:51.836822 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.836798    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrnt\" (UniqueName: \"kubernetes.io/projected/68ac85af-0e48-492b-ba27-b92c551b354c-kube-api-access-gjrnt\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:51.837362 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.837319    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99ms\" (UniqueName: \"kubernetes.io/projected/88d3c016-26a7-4b39-a6c3-ffc80af1a582-kube-api-access-w99ms\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:51.838794 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.838753    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpxk\" (UniqueName: \"kubernetes.io/projected/a21d0c13-42b7-4b20-b308-a0fab54f8f2f-kube-api-access-llpxk\") pod \"managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6\" (UID: \"a21d0c13-42b7-4b20-b308-a0fab54f8f2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.878663 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.878628    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"
May 26 19:47:51.899587 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.899553    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:47:51.913599 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:51.913518    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:47:52.091778 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.091521    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6"]
May 26 19:47:52.096679 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:52.096634    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21d0c13_42b7_4b20_b308_a0fab54f8f2f.slice/crio-00b74321dc0a375d78404443767cd92717d77f15ffd1bae3970232c098bba002 WatchSource:0}: Error finding container 00b74321dc0a375d78404443767cd92717d77f15ffd1bae3970232c098bba002: Status 404 returned error can't find the container with id 00b74321dc0a375d78404443767cd92717d77f15ffd1bae3970232c098bba002
May 26 19:47:52.104423 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.104400    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"]
May 26 19:47:52.107355 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:52.107316    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71bc8cb_0f2f_46c9_8936_0c75c9f3ca39.slice/crio-b759411d53de6a46a4ab042786a8ef87cee47de204e92de5b0e232de15fd52bc WatchSource:0}: Error finding container b759411d53de6a46a4ab042786a8ef87cee47de204e92de5b0e232de15fd52bc: Status 404 returned error can't find the container with id b759411d53de6a46a4ab042786a8ef87cee47de204e92de5b0e232de15fd52bc
May 26 19:47:52.114265 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.114213    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"]
May 26 19:47:52.118398 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:47:52.118368    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod646c41fe_f0bf_4150_a294_fa6627c23c52.slice/crio-d3a4f08aa8a763842e502b9952cb67cfae934f44e5678271aef9c760dac7923c WatchSource:0}: Error finding container d3a4f08aa8a763842e502b9952cb67cfae934f44e5678271aef9c760dac7923c: Status 404 returned error can't find the container with id d3a4f08aa8a763842e502b9952cb67cfae934f44e5678271aef9c760dac7923c
May 26 19:47:52.325736 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.325700    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:52.325736 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.325740    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.325768    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325853    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325876    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325887    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325855    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325915    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:53.325899495 +0000 UTC m=+36.578971464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325951    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:47:53.325938553 +0000 UTC m=+36.579010521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:47:52.326029 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:52.325964    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:47:53.325959235 +0000 UTC m=+36.579031204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:47:52.495200 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.495167    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" event={"ID":"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39","Type":"ContainerStarted","Data":"b759411d53de6a46a4ab042786a8ef87cee47de204e92de5b0e232de15fd52bc"}
May 26 19:47:52.496344 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.496303    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6" event={"ID":"a21d0c13-42b7-4b20-b308-a0fab54f8f2f","Type":"ContainerStarted","Data":"00b74321dc0a375d78404443767cd92717d77f15ffd1bae3970232c098bba002"}
May 26 19:47:52.497393 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:52.497356    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerStarted","Data":"d3a4f08aa8a763842e502b9952cb67cfae934f44e5678271aef9c760dac7923c"}
May 26 19:47:53.316224 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.316189    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:47:53.316824 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.316188    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:53.316824 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.316193    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:47:53.319253 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.319101    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:47:53.319253 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.319117    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:47:53.319465 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.319443    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:47:53.320501 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.320481    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jwk5p\""
May 26 19:47:53.320615 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.320526    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fsc68\""
May 26 19:47:53.320690 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.320652    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 19:47:53.334870 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.334847    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:53.334976 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.334889    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:53.335037 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.334983    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:47:53.335110 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.335037    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:55.335019751 +0000 UTC m=+38.588091724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:47:53.335180 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.334986    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:47:53.335180 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.335145    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:47:53.335180 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:53.335152    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:53.335316 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.335185    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:47:55.335172893 +0000 UTC m=+38.588244862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:47:53.335316 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.335263    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:47:53.335316 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:53.335305    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:47:55.335293314 +0000 UTC m=+38.588365283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:47:55.352758 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:55.352670    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:55.352758 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:55.352734    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:55.352776    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.352944    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.352959    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.353019    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:47:59.352998376 +0000 UTC m=+42.606070347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.353542    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:47:55.353614 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.353592    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:47:59.353576504 +0000 UTC m=+42.606648478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:47:55.353910 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.353651    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:47:55.353910 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:55.353679    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:47:59.353668754 +0000 UTC m=+42.606740726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:47:55.512629 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:55.512547    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="5bf469f12ccaf12385577cfec4431a7035d114688bb1296aa1f6281080c1f4d5" exitCode=0
May 26 19:47:55.512811 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:55.512634    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"5bf469f12ccaf12385577cfec4431a7035d114688bb1296aa1f6281080c1f4d5"}
May 26 19:47:56.520180 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:56.520068    2573 generic.go:358] "Generic (PLEG): container finished" podID="cfeecbfd-f4ab-49a3-b56a-0807652fe579" containerID="fa75d7ab3d4678321efbaf3f14ddb12b339245fc28da69c03a3ed7d2759aaeca" exitCode=0
May 26 19:47:56.520180 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:56.520144    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerDied","Data":"fa75d7ab3d4678321efbaf3f14ddb12b339245fc28da69c03a3ed7d2759aaeca"}
May 26 19:47:56.663797 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:56.663406    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:56.667486 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:56.667431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4c607f4-ca87-49a5-b2f7-617adc43670f-original-pull-secret\") pod \"global-pull-secret-syncer-cbmjp\" (UID: \"f4c607f4-ca87-49a5-b2f7-617adc43670f\") " pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:56.936036 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:56.935948    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cbmjp"
May 26 19:47:59.388648 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:59.388595    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:59.388667    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:47:59.388704    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388769    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388810    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388841    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388858    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388847    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:48:07.388824896 +0000 UTC m=+50.641896871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388916    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:48:07.388900284 +0000 UTC m=+50.641972258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:47:59.389114 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:47:59.388930    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:48:07.388922453 +0000 UTC m=+50.641994421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:48:01.889976 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:01.889942    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cbmjp"]
May 26 19:48:01.893375 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:48:01.893345    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c607f4_ca87_49a5_b2f7_617adc43670f.slice/crio-4fa0a745364d6864aa800dd4e8793c195c7f7fd8a9ad59c4a1daf5f85846a195 WatchSource:0}: Error finding container 4fa0a745364d6864aa800dd4e8793c195c7f7fd8a9ad59c4a1daf5f85846a195: Status 404 returned error can't find the container with id 4fa0a745364d6864aa800dd4e8793c195c7f7fd8a9ad59c4a1daf5f85846a195
May 26 19:48:02.535134 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.535096    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ncsts" event={"ID":"cfeecbfd-f4ab-49a3-b56a-0807652fe579","Type":"ContainerStarted","Data":"8977d1646e73360d637f176e18ab165fe6974334a365b96e2cc6d57b5430ed55"}
May 26 19:48:02.536345 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.536303    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" event={"ID":"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39","Type":"ContainerStarted","Data":"51e79ef25dc72ebf4b73c10274be45082c22a480abd6e58a355b3c454542bc49"}
May 26 19:48:02.536528 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.536510    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:48:02.537665 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.537645    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerStarted","Data":"30173619afe533f33a057c8b30419d81a2f44244ac889cb44951334413aac74d"}
May 26 19:48:02.538449 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.538432    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:48:02.539028 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.539011    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6" event={"ID":"a21d0c13-42b7-4b20-b308-a0fab54f8f2f","Type":"ContainerStarted","Data":"b2a927b52fb8a43b8e3f1aff00db658370693d4368df3ba13489f658bf64a7bd"}
May 26 19:48:02.539929 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.539904    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cbmjp" event={"ID":"f4c607f4-ca87-49a5-b2f7-617adc43670f","Type":"ContainerStarted","Data":"4fa0a745364d6864aa800dd4e8793c195c7f7fd8a9ad59c4a1daf5f85846a195"}
May 26 19:48:02.574999 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.574953    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ncsts" podStartSLOduration=10.478988406 podStartE2EDuration="45.574940091s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:47:19.675867128 +0000 UTC m=+2.928939098" lastFinishedPulling="2026-05-26 19:47:54.771818598 +0000 UTC m=+38.024890783" observedRunningTime="2026-05-26 19:48:02.573350425 +0000 UTC m=+45.826422409" watchObservedRunningTime="2026-05-26 19:48:02.574940091 +0000 UTC m=+45.828012082"
May 26 19:48:02.633790 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.633741    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6" podStartSLOduration=29.016698766 podStartE2EDuration="38.633728137s" podCreationTimestamp="2026-05-26 19:47:24 +0000 UTC" firstStartedPulling="2026-05-26 19:47:52.098655593 +0000 UTC m=+35.351727562" lastFinishedPulling="2026-05-26 19:48:01.715684963 +0000 UTC m=+44.968756933" observedRunningTime="2026-05-26 19:48:02.603025086 +0000 UTC m=+45.856097077" watchObservedRunningTime="2026-05-26 19:48:02.633728137 +0000 UTC m=+45.886800130"
May 26 19:48:02.634237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:02.634214    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" podStartSLOduration=28.989330658 podStartE2EDuration="38.634207974s" podCreationTimestamp="2026-05-26 19:47:24 +0000 UTC" firstStartedPulling="2026-05-26 19:47:52.109781426 +0000 UTC m=+35.362853395" lastFinishedPulling="2026-05-26 19:48:01.754658736 +0000 UTC m=+45.007730711" observedRunningTime="2026-05-26 19:48:02.632953071 +0000 UTC m=+45.886025062" watchObservedRunningTime="2026-05-26 19:48:02.634207974 +0000 UTC m=+45.887279966"
May 26 19:48:07.452656 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.452609    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:48:07.452656 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.452661    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.452760    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.452774    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.452771    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.452834    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:48:23.452816562 +0000 UTC m=+66.705888553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.452904    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:48:23.452882132 +0000 UTC m=+66.705954105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.452968    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.453053    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:48:07.453142 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:07.453089    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:48:23.453080295 +0000 UTC m=+66.706152265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:48:07.553167 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.553130    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerStarted","Data":"33aa440d8a35b6399771fe503a5774afd71c79f5c6c24d42f5a44446b44b5c6a"}
May 26 19:48:07.553167 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.553171    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerStarted","Data":"5986723603cdbf1dce881b6735d08638c209639742f75a8eba32b40867a79fe6"}
May 26 19:48:07.554492 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.554469    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cbmjp" event={"ID":"f4c607f4-ca87-49a5-b2f7-617adc43670f","Type":"ContainerStarted","Data":"5e15c6dae97c8be3e4ee09f6fb1a227071a498c4211a77a0a82b2ffd958c2724"}
May 26 19:48:07.571717 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.571663    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" podStartSLOduration=29.074341018 podStartE2EDuration="43.57164822s" podCreationTimestamp="2026-05-26 19:47:24 +0000 UTC" firstStartedPulling="2026-05-26 19:47:52.12022768 +0000 UTC m=+35.373299650" lastFinishedPulling="2026-05-26 19:48:06.617534883 +0000 UTC m=+49.870606852" observedRunningTime="2026-05-26 19:48:07.570781516 +0000 UTC m=+50.823853533" watchObservedRunningTime="2026-05-26 19:48:07.57164822 +0000 UTC m=+50.824720211"
May 26 19:48:07.595110 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:07.595058    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cbmjp" podStartSLOduration=38.855367195 podStartE2EDuration="43.595043542s" podCreationTimestamp="2026-05-26 19:47:24 +0000 UTC" firstStartedPulling="2026-05-26 19:48:01.895150608 +0000 UTC m=+45.148222577" lastFinishedPulling="2026-05-26 19:48:06.634826951 +0000 UTC m=+49.887898924" observedRunningTime="2026-05-26 19:48:07.594766782 +0000 UTC m=+50.847838784" watchObservedRunningTime="2026-05-26 19:48:07.595043542 +0000 UTC m=+50.848115542"
May 26 19:48:17.499560 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:17.499526    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4kwm"
May 26 19:48:23.073786 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.073747    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:48:23.076090 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.076071    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:48:23.084141 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.084115    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:48:23.084262 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.084183    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:49:27.084165207 +0000 UTC m=+130.337237175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : secret "metrics-daemon-secret" not found
May 26 19:48:23.174484 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.174431    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:48:23.177261 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.177238    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:48:23.191592 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.191568    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:48:23.197995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.197964    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sh86\" (UniqueName: \"kubernetes.io/projected/9ac75fb6-aedc-4ecf-99b8-6672cca54003-kube-api-access-7sh86\") pod \"network-check-target-89pjd\" (UID: \"9ac75fb6-aedc-4ecf-99b8-6672cca54003\") " pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:48:23.334713 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.334637    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fsc68\""
May 26 19:48:23.339306 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.339291    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:48:23.461490 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.461458    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-89pjd"]
May 26 19:48:23.464601 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:48:23.464573    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac75fb6_aedc_4ecf_99b8_6672cca54003.slice/crio-bc9d3b5b85a670344db957d8d2ba54480c44bdc30564e58086aa70f0bb57a4d2 WatchSource:0}: Error finding container bc9d3b5b85a670344db957d8d2ba54480c44bdc30564e58086aa70f0bb57a4d2: Status 404 returned error can't find the container with id bc9d3b5b85a670344db957d8d2ba54480c44bdc30564e58086aa70f0bb57a4d2
May 26 19:48:23.476637 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.476611    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:48:23.476768 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.476660    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:48:23.476768 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.476684    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:48:23.476874 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476765    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:48:23.476874 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476791    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:48:23.476874 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476837    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:48:55.476820338 +0000 UTC m=+98.729892308 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:48:23.476874 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476852    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:48:55.476845316 +0000 UTC m=+98.729917285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:48:23.476874 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476861    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:48:23.477068 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476881    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:48:23.477068 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:23.476945    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:48:55.476926769 +0000 UTC m=+98.729998744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:48:23.593840 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:23.593749    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-89pjd" event={"ID":"9ac75fb6-aedc-4ecf-99b8-6672cca54003","Type":"ContainerStarted","Data":"bc9d3b5b85a670344db957d8d2ba54480c44bdc30564e58086aa70f0bb57a4d2"}
May 26 19:48:27.605224 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:27.605177    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-89pjd" event={"ID":"9ac75fb6-aedc-4ecf-99b8-6672cca54003","Type":"ContainerStarted","Data":"3f5227f6036f27453c582d8f18a6ed3ee61676661934bc5bbc25e00762df81f2"}
May 26 19:48:27.605607 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:27.605302    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:48:27.622426 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:27.622372    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-89pjd" podStartSLOduration=67.274425205 podStartE2EDuration="1m10.62235628s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:48:23.466555018 +0000 UTC m=+66.719626990" lastFinishedPulling="2026-05-26 19:48:26.814486093 +0000 UTC m=+70.067558065" observedRunningTime="2026-05-26 19:48:27.621134218 +0000 UTC m=+70.874206209" watchObservedRunningTime="2026-05-26 19:48:27.62235628 +0000 UTC m=+70.875428271"
May 26 19:48:55.521400 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:55.521345    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:48:55.521400 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:55.521407    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521439    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:55.521471    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521516    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert podName:88d3c016-26a7-4b39-a6c3-ffc80af1a582 nodeName:}" failed. No retries permitted until 2026-05-26 19:49:59.521494139 +0000 UTC m=+162.774566131 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert") pod "ingress-canary-pgkrz" (UID: "88d3c016-26a7-4b39-a6c3-ffc80af1a582") : secret "canary-serving-cert" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521557    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521574    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-948565b6d-fbkl4: secret "image-registry-tls" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521559    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521618    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls podName:13143c99-9864-4d4d-b7d8-077fa5e3475e nodeName:}" failed. No retries permitted until 2026-05-26 19:49:59.521605503 +0000 UTC m=+162.774677490 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls") pod "image-registry-948565b6d-fbkl4" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e") : secret "image-registry-tls" not found
May 26 19:48:55.521852 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:48:55.521642    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls podName:68ac85af-0e48-492b-ba27-b92c551b354c nodeName:}" failed. No retries permitted until 2026-05-26 19:49:59.521630786 +0000 UTC m=+162.774702755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls") pod "dns-default-lfww2" (UID: "68ac85af-0e48-492b-ba27-b92c551b354c") : secret "dns-default-metrics-tls" not found
May 26 19:48:58.610128 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:48:58.610095    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-89pjd"
May 26 19:49:27.160105 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:27.160062    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:49:27.160728 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:27.160251    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:49:27.160728 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:27.160399    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs podName:42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4 nodeName:}" failed. No retries permitted until 2026-05-26 19:51:29.160375969 +0000 UTC m=+252.413447954 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs") pod "network-metrics-daemon-dmt5b" (UID: "42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4") : secret "metrics-daemon-secret" not found
May 26 19:49:41.183567 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:41.183536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-srzdg_86d43817-1b3e-4e9e-a80f-13fdc2301ff2/dns-node-resolver/0.log"
May 26 19:49:42.183791 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:42.183761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8t95_9f94ddcb-68c9-4425-acfc-46ff8a3c55c5/node-ca/0.log"
May 26 19:49:54.588520 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:54.588471    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e"
May 26 19:49:54.641285 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:54.641246    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lfww2" podUID="68ac85af-0e48-492b-ba27-b92c551b354c"
May 26 19:49:54.647409 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:54.647381    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-pgkrz" podUID="88d3c016-26a7-4b39-a6c3-ffc80af1a582"
May 26 19:49:54.810587 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:54.810556    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:49:54.810720 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:54.810670    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:49:54.810847 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:54.810832    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfww2"
May 26 19:49:56.341964 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:49:56.341903    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dmt5b" podUID="42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4"
May 26 19:49:59.615121 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.615059    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:49:59.615740 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.615187    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:49:59.615740 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.615224    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:49:59.620082 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.618348    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68ac85af-0e48-492b-ba27-b92c551b354c-metrics-tls\") pod \"dns-default-lfww2\" (UID: \"68ac85af-0e48-492b-ba27-b92c551b354c\") " pod="openshift-dns/dns-default-lfww2"
May 26 19:49:59.620082 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.618415    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"image-registry-948565b6d-fbkl4\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") " pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:49:59.621145 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.621117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88d3c016-26a7-4b39-a6c3-ffc80af1a582-cert\") pod \"ingress-canary-pgkrz\" (UID: \"88d3c016-26a7-4b39-a6c3-ffc80af1a582\") " pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:49:59.915105 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.915013    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c99wf\""
May 26 19:49:59.915105 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.915038    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rmf4h\""
May 26 19:49:59.915105 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.915098    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bslzb\""
May 26 19:49:59.922317 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.922290    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:49:59.922317 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.922305    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lfww2"
May 26 19:49:59.922494 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:49:59.922314    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pgkrz"
May 26 19:50:00.075357 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.075297    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pgkrz"]
May 26 19:50:00.079488 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:50:00.079458    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d3c016_26a7_4b39_a6c3_ffc80af1a582.slice/crio-508bd0760fe320167a47d184c37d01a611681aa0a7fa0d9cbfd81544d5d97977 WatchSource:0}: Error finding container 508bd0760fe320167a47d184c37d01a611681aa0a7fa0d9cbfd81544d5d97977: Status 404 returned error can't find the container with id 508bd0760fe320167a47d184c37d01a611681aa0a7fa0d9cbfd81544d5d97977
May 26 19:50:00.298064 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.298029    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lfww2"]
May 26 19:50:00.301209 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.301181    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:50:00.301648 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:50:00.301619    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ac85af_0e48_492b_ba27_b92c551b354c.slice/crio-290120fd4482fa1b31dd357ab97d1b05a08667e55912e3ee061d0a251f9e4451 WatchSource:0}: Error finding container 290120fd4482fa1b31dd357ab97d1b05a08667e55912e3ee061d0a251f9e4451: Status 404 returned error can't find the container with id 290120fd4482fa1b31dd357ab97d1b05a08667e55912e3ee061d0a251f9e4451
May 26 19:50:00.304380 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:50:00.304355    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13143c99_9864_4d4d_b7d8_077fa5e3475e.slice/crio-0c73e41fcf6a7805c081e4e24610b29180a1cc47a9a500f164d4229365365cea WatchSource:0}: Error finding container 0c73e41fcf6a7805c081e4e24610b29180a1cc47a9a500f164d4229365365cea: Status 404 returned error can't find the container with id 0c73e41fcf6a7805c081e4e24610b29180a1cc47a9a500f164d4229365365cea
May 26 19:50:00.826620 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.826575    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfww2" event={"ID":"68ac85af-0e48-492b-ba27-b92c551b354c","Type":"ContainerStarted","Data":"290120fd4482fa1b31dd357ab97d1b05a08667e55912e3ee061d0a251f9e4451"}
May 26 19:50:00.828127 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.828095    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" event={"ID":"13143c99-9864-4d4d-b7d8-077fa5e3475e","Type":"ContainerStarted","Data":"97902c4f09724554ba676fb57ee2d53b574808ceaaa3103f9504204edca98efc"}
May 26 19:50:00.828282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.828134    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" event={"ID":"13143c99-9864-4d4d-b7d8-077fa5e3475e","Type":"ContainerStarted","Data":"0c73e41fcf6a7805c081e4e24610b29180a1cc47a9a500f164d4229365365cea"}
May 26 19:50:00.828282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.828174    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:50:00.829448 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.829421    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgkrz" event={"ID":"88d3c016-26a7-4b39-a6c3-ffc80af1a582","Type":"ContainerStarted","Data":"508bd0760fe320167a47d184c37d01a611681aa0a7fa0d9cbfd81544d5d97977"}
May 26 19:50:00.847957 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:00.847880    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" podStartSLOduration=163.847860896 podStartE2EDuration="2m43.847860896s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:50:00.847729296 +0000 UTC m=+164.100801279" watchObservedRunningTime="2026-05-26 19:50:00.847860896 +0000 UTC m=+164.100932889"
May 26 19:50:01.546557 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.546518    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ttrzg"]
May 26 19:50:01.548551 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.548523    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.551821 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.551793    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 19:50:01.551982 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.551855    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 19:50:01.552908 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.552888    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8vl7s\""
May 26 19:50:01.553031 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.552943    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 19:50:01.553031 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.552955    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 19:50:01.561170 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.561138    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttrzg"]
May 26 19:50:01.633578 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.633541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5653c64-341c-465b-bdc9-0af1496ca68b-crio-socket\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.633838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.633609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.633838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.633693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5653c64-341c-465b-bdc9-0af1496ca68b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.633838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.633734    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl52h\" (UniqueName: \"kubernetes.io/projected/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-api-access-sl52h\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.633838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.633769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5653c64-341c-465b-bdc9-0af1496ca68b-data-volume\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734733 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734691    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5653c64-341c-465b-bdc9-0af1496ca68b-crio-socket\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734754    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734775    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5653c64-341c-465b-bdc9-0af1496ca68b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734791    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sl52h\" (UniqueName: \"kubernetes.io/projected/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-api-access-sl52h\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734812    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5653c64-341c-465b-bdc9-0af1496ca68b-data-volume\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.734921 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.734835    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5653c64-341c-465b-bdc9-0af1496ca68b-crio-socket\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.735207 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.735185    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5653c64-341c-465b-bdc9-0af1496ca68b-data-volume\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.735624 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.735589    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.737597 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.737571    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5653c64-341c-465b-bdc9-0af1496ca68b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.748304 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.748259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl52h\" (UniqueName: \"kubernetes.io/projected/e5653c64-341c-465b-bdc9-0af1496ca68b-kube-api-access-sl52h\") pod \"insights-runtime-extractor-ttrzg\" (UID: \"e5653c64-341c-465b-bdc9-0af1496ca68b\") " pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:01.858568 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:01.858482    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttrzg"
May 26 19:50:02.536810 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.536747    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" podUID="c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused"
May 26 19:50:02.540557 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.540527    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttrzg"]
May 26 19:50:02.544031 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:50:02.543998    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5653c64_341c_465b_bdc9_0af1496ca68b.slice/crio-4e7694fc900b7eed50c99c269eef3da6f8587971e31e638e3b28afaacbc1d49f WatchSource:0}: Error finding container 4e7694fc900b7eed50c99c269eef3da6f8587971e31e638e3b28afaacbc1d49f: Status 404 returned error can't find the container with id 4e7694fc900b7eed50c99c269eef3da6f8587971e31e638e3b28afaacbc1d49f
May 26 19:50:02.839768 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.839726    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttrzg" event={"ID":"e5653c64-341c-465b-bdc9-0af1496ca68b","Type":"ContainerStarted","Data":"2fc7cd629b7ed6150ba8712e900ba6c5f423cc87c27a508f419b50bb0570449e"}
May 26 19:50:02.839768 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.839771    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttrzg" event={"ID":"e5653c64-341c-465b-bdc9-0af1496ca68b","Type":"ContainerStarted","Data":"4e7694fc900b7eed50c99c269eef3da6f8587971e31e638e3b28afaacbc1d49f"}
May 26 19:50:02.840965 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.840940    2573 generic.go:358] "Generic (PLEG): container finished" podID="a21d0c13-42b7-4b20-b308-a0fab54f8f2f" containerID="b2a927b52fb8a43b8e3f1aff00db658370693d4368df3ba13489f658bf64a7bd" exitCode=255
May 26 19:50:02.841083 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.841006    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6" event={"ID":"a21d0c13-42b7-4b20-b308-a0fab54f8f2f","Type":"ContainerDied","Data":"b2a927b52fb8a43b8e3f1aff00db658370693d4368df3ba13489f658bf64a7bd"}
May 26 19:50:02.841339 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.841311    2573 scope.go:117] "RemoveContainer" containerID="b2a927b52fb8a43b8e3f1aff00db658370693d4368df3ba13489f658bf64a7bd"
May 26 19:50:02.842602 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.842573    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfww2" event={"ID":"68ac85af-0e48-492b-ba27-b92c551b354c","Type":"ContainerStarted","Data":"eeed59fd902cc413a2836920dd86b93a375605187759345576452c70963971de"}
May 26 19:50:02.842792 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.842610    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lfww2" event={"ID":"68ac85af-0e48-492b-ba27-b92c551b354c","Type":"ContainerStarted","Data":"cbb0a2cc4c8c27cdd214f360530236181d583ac39e20fd978b9b0b0b02d83be6"}
May 26 19:50:02.842792 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.842651    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lfww2"
May 26 19:50:02.843900 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.843822    2573 generic.go:358] "Generic (PLEG): container finished" podID="c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39" containerID="51e79ef25dc72ebf4b73c10274be45082c22a480abd6e58a355b3c454542bc49" exitCode=1
May 26 19:50:02.843900 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.843886    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" event={"ID":"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39","Type":"ContainerDied","Data":"51e79ef25dc72ebf4b73c10274be45082c22a480abd6e58a355b3c454542bc49"}
May 26 19:50:02.844177 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.844160    2573 scope.go:117] "RemoveContainer" containerID="51e79ef25dc72ebf4b73c10274be45082c22a480abd6e58a355b3c454542bc49"
May 26 19:50:02.847838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.847815    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pgkrz" event={"ID":"88d3c016-26a7-4b39-a6c3-ffc80af1a582","Type":"ContainerStarted","Data":"ae32afd3bd62104011ed4cbe656e1b575703e8d9382f0e98595641679759ad3a"}
May 26 19:50:02.879545 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.879497    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lfww2" podStartSLOduration=129.77452329 podStartE2EDuration="2m11.879484174s" podCreationTimestamp="2026-05-26 19:47:51 +0000 UTC" firstStartedPulling="2026-05-26 19:50:00.303440253 +0000 UTC m=+163.556512222" lastFinishedPulling="2026-05-26 19:50:02.408401122 +0000 UTC m=+165.661473106" observedRunningTime="2026-05-26 19:50:02.878981009 +0000 UTC m=+166.132053018" watchObservedRunningTime="2026-05-26 19:50:02.879484174 +0000 UTC m=+166.132556164"
May 26 19:50:02.919635 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:02.919573    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pgkrz" podStartSLOduration=129.594526427 podStartE2EDuration="2m11.919552888s" podCreationTimestamp="2026-05-26 19:47:51 +0000 UTC" firstStartedPulling="2026-05-26 19:50:00.081750823 +0000 UTC m=+163.334822792" lastFinishedPulling="2026-05-26 19:50:02.406777269 +0000 UTC m=+165.659849253" observedRunningTime="2026-05-26 19:50:02.918702372 +0000 UTC m=+166.171774362" watchObservedRunningTime="2026-05-26 19:50:02.919552888 +0000 UTC m=+166.172624882"
May 26 19:50:03.852451 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:03.852357    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttrzg" event={"ID":"e5653c64-341c-465b-bdc9-0af1496ca68b","Type":"ContainerStarted","Data":"e5e45b4e1fb2940455363028469087e56425e489092f26ecf87883abf776008a"}
May 26 19:50:03.853800 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:03.853767    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b5fc657f8-nhkl6" event={"ID":"a21d0c13-42b7-4b20-b308-a0fab54f8f2f","Type":"ContainerStarted","Data":"5115c838320919cdf76d629b8a70ea9543fd65ccfedb57d496f0b46163b14768"}
May 26 19:50:03.855271 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:03.855246    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" event={"ID":"c71bc8cb-0f2f-46c9-8936-0c75c9f3ca39","Type":"ContainerStarted","Data":"061ed4a42d856dff774b65e6a457d37653ade7ffa4aa158bb7fd4ecbcb794d0d"}
May 26 19:50:03.855645 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:03.855625    2573 status_manager.go:355] "Container readiness changed for unknown container" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66" containerID="cri-o://51e79ef25dc72ebf4b73c10274be45082c22a480abd6e58a355b3c454542bc49"
May 26 19:50:03.855645 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:03.855644    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:50:04.857995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:04.857965    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:50:04.858705 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:04.858677    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6dd99c68-fdm66"
May 26 19:50:05.865117 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:05.865077    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttrzg" event={"ID":"e5653c64-341c-465b-bdc9-0af1496ca68b","Type":"ContainerStarted","Data":"c8915cf087e292c71ddf522d0171c14b767772d708c49cfd0502c491b937e288"}
May 26 19:50:05.883466 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:05.883411    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ttrzg" podStartSLOduration=2.152498186 podStartE2EDuration="4.883396709s" podCreationTimestamp="2026-05-26 19:50:01 +0000 UTC" firstStartedPulling="2026-05-26 19:50:02.618703808 +0000 UTC m=+165.871775781" lastFinishedPulling="2026-05-26 19:50:05.349602332 +0000 UTC m=+168.602674304" observedRunningTime="2026-05-26 19:50:05.882002194 +0000 UTC m=+169.135074185" watchObservedRunningTime="2026-05-26 19:50:05.883396709 +0000 UTC m=+169.136468700"
May 26 19:50:07.316880 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:07.316833    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:50:11.918031 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:11.917990    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" podUID="646c41fe-f0bf-4150-a294-fa6627c23c52" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:50:12.857911 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:12.857874    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lfww2"
May 26 19:50:13.509537 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.509508    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k4tnc"]
May 26 19:50:13.512141 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.512124    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.516415 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.516392    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 19:50:13.516631 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.516612    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l5g6j\""
May 26 19:50:13.516828 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.516804    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 19:50:13.529838 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.529810    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 19:50:13.529995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.529868    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 19:50:13.529995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.529876    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 19:50:13.530274 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.530250    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 19:50:13.627621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627795 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-root\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627795 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627882 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-sys\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627882 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627840    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-textfile\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627882 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-metrics-client-ca\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhst\" (UniqueName: \"kubernetes.io/projected/4e579868-b9d9-460e-8275-e0c6b2bc4595-kube-api-access-rnhst\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.627996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.627937    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-wtmp\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729321 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729273    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729511 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729354    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-sys\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729511 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729383    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-textfile\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729511 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729401    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-metrics-client-ca\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729511 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729451    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-sys\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729509    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729540    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhst\" (UniqueName: \"kubernetes.io/projected/4e579868-b9d9-460e-8275-e0c6b2bc4595-kube-api-access-rnhst\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729573    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-wtmp\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729608    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729652    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-root\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:50:13.729674    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-root\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:50:13.729752    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls podName:4e579868-b9d9-460e-8275-e0c6b2bc4595 nodeName:}" failed. No retries permitted until 2026-05-26 19:50:14.229731099 +0000 UTC m=+177.482803083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls") pod "node-exporter-k4tnc" (UID: "4e579868-b9d9-460e-8275-e0c6b2bc4595") : secret "node-exporter-tls" not found
May 26 19:50:13.729756 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-wtmp\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.730131 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.729807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-textfile\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.730205 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.730186    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-metrics-client-ca\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.730271 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.730248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-accelerators-collector-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.731826 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.731809    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:13.740081 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:13.740051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhst\" (UniqueName: \"kubernetes.io/projected/4e579868-b9d9-460e-8275-e0c6b2bc4595-kube-api-access-rnhst\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:14.233014 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:14.232970    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:14.235309 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:14.235274    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e579868-b9d9-460e-8275-e0c6b2bc4595-node-exporter-tls\") pod \"node-exporter-k4tnc\" (UID: \"4e579868-b9d9-460e-8275-e0c6b2bc4595\") " pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:14.420760 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:14.420718    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k4tnc"
May 26 19:50:14.428537 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:50:14.428508    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e579868_b9d9_460e_8275_e0c6b2bc4595.slice/crio-a4b7d2eed9ea6a60ee437bc212e9de9ac0110c43c856acb7aeebdb909f2fd47a WatchSource:0}: Error finding container a4b7d2eed9ea6a60ee437bc212e9de9ac0110c43c856acb7aeebdb909f2fd47a: Status 404 returned error can't find the container with id a4b7d2eed9ea6a60ee437bc212e9de9ac0110c43c856acb7aeebdb909f2fd47a
May 26 19:50:14.887768 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:14.887722    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4tnc" event={"ID":"4e579868-b9d9-460e-8275-e0c6b2bc4595","Type":"ContainerStarted","Data":"a4b7d2eed9ea6a60ee437bc212e9de9ac0110c43c856acb7aeebdb909f2fd47a"}
May 26 19:50:15.891896 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:15.891859    2573 generic.go:358] "Generic (PLEG): container finished" podID="4e579868-b9d9-460e-8275-e0c6b2bc4595" containerID="524413a5d5ccf3fc2987e66ffa5b541a9ae9247fe9ffd9b9e5dc4a48918cbdca" exitCode=0
May 26 19:50:15.892345 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:15.891932    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4tnc" event={"ID":"4e579868-b9d9-460e-8275-e0c6b2bc4595","Type":"ContainerDied","Data":"524413a5d5ccf3fc2987e66ffa5b541a9ae9247fe9ffd9b9e5dc4a48918cbdca"}
May 26 19:50:16.896322 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:16.896280    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4tnc" event={"ID":"4e579868-b9d9-460e-8275-e0c6b2bc4595","Type":"ContainerStarted","Data":"329c06d88b59ed1e3c68c93527af6f4f63205b85dc8c908a0ae7baafe624f29a"}
May 26 19:50:16.896322 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:16.896322    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k4tnc" event={"ID":"4e579868-b9d9-460e-8275-e0c6b2bc4595","Type":"ContainerStarted","Data":"83f2b50e07c1f9d8bf3869d534eb3049730b44da507c764157ecfbdc2310af78"}
May 26 19:50:16.916858 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:16.916802    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k4tnc" podStartSLOduration=3.052022421 podStartE2EDuration="3.916777492s" podCreationTimestamp="2026-05-26 19:50:13 +0000 UTC" firstStartedPulling="2026-05-26 19:50:14.430307758 +0000 UTC m=+177.683379727" lastFinishedPulling="2026-05-26 19:50:15.295062812 +0000 UTC m=+178.548134798" observedRunningTime="2026-05-26 19:50:16.914861819 +0000 UTC m=+180.167933834" watchObservedRunningTime="2026-05-26 19:50:16.916777492 +0000 UTC m=+180.169849482"
May 26 19:50:19.930942 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:19.930906    2573 patch_prober.go:28] interesting pod/image-registry-948565b6d-fbkl4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 19:50:19.931403 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:19.930963    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:50:21.836282 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:21.836250    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:50:21.915372 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:21.915312    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" podUID="646c41fe-f0bf-4150-a294-fa6627c23c52" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:50:23.788501 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:23.788463    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:50:31.915209 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:31.915167    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" podUID="646c41fe-f0bf-4150-a294-fa6627c23c52" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:50:31.915672 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:31.915251    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb"
May 26 19:50:31.915788 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:31.915757    2573 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"33aa440d8a35b6399771fe503a5774afd71c79f5c6c24d42f5a44446b44b5c6a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 19:50:31.915825 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:31.915810    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" podUID="646c41fe-f0bf-4150-a294-fa6627c23c52" containerName="service-proxy" containerID="cri-o://33aa440d8a35b6399771fe503a5774afd71c79f5c6c24d42f5a44446b44b5c6a" gracePeriod=30
May 26 19:50:32.937805 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:32.937773    2573 generic.go:358] "Generic (PLEG): container finished" podID="646c41fe-f0bf-4150-a294-fa6627c23c52" containerID="33aa440d8a35b6399771fe503a5774afd71c79f5c6c24d42f5a44446b44b5c6a" exitCode=2
May 26 19:50:32.938178 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:32.937841    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerDied","Data":"33aa440d8a35b6399771fe503a5774afd71c79f5c6c24d42f5a44446b44b5c6a"}
May 26 19:50:32.938178 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:32.937878    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-874b58676-rfnkb" event={"ID":"646c41fe-f0bf-4150-a294-fa6627c23c52","Type":"ContainerStarted","Data":"a1e578f0fb2f9ddb7d187402f9b4b3535cf696fa711a03a43258f65b39c88729"}
May 26 19:50:48.807207 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:48.807158    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerName="registry" containerID="cri-o://97902c4f09724554ba676fb57ee2d53b574808ceaaa3103f9504204edca98efc" gracePeriod=30
May 26 19:50:48.984069 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:48.980128    2573 generic.go:358] "Generic (PLEG): container finished" podID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerID="97902c4f09724554ba676fb57ee2d53b574808ceaaa3103f9504204edca98efc" exitCode=0
May 26 19:50:48.984069 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:48.980249    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" event={"ID":"13143c99-9864-4d4d-b7d8-077fa5e3475e","Type":"ContainerDied","Data":"97902c4f09724554ba676fb57ee2d53b574808ceaaa3103f9504204edca98efc"}
May 26 19:50:49.054782 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.054754    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:50:49.106006 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.105906    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106006 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.105949    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106006 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.105968    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106006 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106006    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hlq9\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106360 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106069    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106360 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106106    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106360 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106307    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106514 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106409    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca\") pod \"13143c99-9864-4d4d-b7d8-077fa5e3475e\" (UID: \"13143c99-9864-4d4d-b7d8-077fa5e3475e\") "
May 26 19:50:49.106514 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106493    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:50:49.106681 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106639    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-certificates\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.107036 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.106982    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:50:49.108541 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.108510    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:50:49.108840 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.108803    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:50:49.108957 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.108870    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:50:49.109024 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.108975    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:50:49.109157 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.109138    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9" (OuterVolumeSpecName: "kube-api-access-7hlq9") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "kube-api-access-7hlq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:50:49.114892 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.114862    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13143c99-9864-4d4d-b7d8-077fa5e3475e" (UID: "13143c99-9864-4d4d-b7d8-077fa5e3475e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:50:49.207995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.207959    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13143c99-9864-4d4d-b7d8-077fa5e3475e-ca-trust-extracted\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.207995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.207990    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-installation-pull-secrets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.207995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.208003    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13143c99-9864-4d4d-b7d8-077fa5e3475e-trusted-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.208222 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.208011    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-bound-sa-token\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.208222 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.208020    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-registry-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.208222 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.208028    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hlq9\" (UniqueName: \"kubernetes.io/projected/13143c99-9864-4d4d-b7d8-077fa5e3475e-kube-api-access-7hlq9\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.208222 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.208038    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13143c99-9864-4d4d-b7d8-077fa5e3475e-image-registry-private-configuration\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 19:50:49.983615 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.983579    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-948565b6d-fbkl4" event={"ID":"13143c99-9864-4d4d-b7d8-077fa5e3475e","Type":"ContainerDied","Data":"0c73e41fcf6a7805c081e4e24610b29180a1cc47a9a500f164d4229365365cea"}
May 26 19:50:49.983615 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.983601    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-948565b6d-fbkl4"
May 26 19:50:49.983615 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:49.983622    2573 scope.go:117] "RemoveContainer" containerID="97902c4f09724554ba676fb57ee2d53b574808ceaaa3103f9504204edca98efc"
May 26 19:50:50.000813 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:50.000786    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:50:50.004228 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:50.004201    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-948565b6d-fbkl4"]
May 26 19:50:51.319530 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:50:51.319495    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" path="/var/lib/kubelet/pods/13143c99-9864-4d4d-b7d8-077fa5e3475e/volumes"
May 26 19:51:29.212202 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:29.212160    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:51:29.214484 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:29.214459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4-metrics-certs\") pod \"network-metrics-daemon-dmt5b\" (UID: \"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4\") " pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:51:29.220146 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:29.220120    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jwk5p\""
May 26 19:51:29.227484 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:29.227455    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmt5b"
May 26 19:51:29.352687 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:29.352654    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmt5b"]
May 26 19:51:29.356261 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:51:29.356209    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c9c5a0_7ca1_412f_880c_fc7a46f9e5d4.slice/crio-d497a49c95eb1c63fa9a4d21c787a45ba089585283fcd830caa0f07b67b4af7e WatchSource:0}: Error finding container d497a49c95eb1c63fa9a4d21c787a45ba089585283fcd830caa0f07b67b4af7e: Status 404 returned error can't find the container with id d497a49c95eb1c63fa9a4d21c787a45ba089585283fcd830caa0f07b67b4af7e
May 26 19:51:30.086290 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:30.086249    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmt5b" event={"ID":"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4","Type":"ContainerStarted","Data":"d497a49c95eb1c63fa9a4d21c787a45ba089585283fcd830caa0f07b67b4af7e"}
May 26 19:51:31.090058 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:31.090020    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmt5b" event={"ID":"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4","Type":"ContainerStarted","Data":"491f59a72a8129bbc9dee438e2b7460c655a8451739100b66a55662f82166f3e"}
May 26 19:51:31.090058 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:31.090062    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmt5b" event={"ID":"42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4","Type":"ContainerStarted","Data":"042cf198f1ef8e8854424e73284e32d6b27ed8ce313ec934282be1029198615e"}
May 26 19:51:31.106621 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:51:31.106442    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dmt5b" podStartSLOduration=253.134086556 podStartE2EDuration="4m14.106424156s" podCreationTimestamp="2026-05-26 19:47:17 +0000 UTC" firstStartedPulling="2026-05-26 19:51:29.357969001 +0000 UTC m=+252.611040984" lastFinishedPulling="2026-05-26 19:51:30.330306605 +0000 UTC m=+253.583378584" observedRunningTime="2026-05-26 19:51:31.106017476 +0000 UTC m=+254.359089468" watchObservedRunningTime="2026-05-26 19:51:31.106424156 +0000 UTC m=+254.359496147"
May 26 19:52:17.262787 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:52:17.262761    2573 kubelet.go:1628] "Image garbage collection succeeded"
May 26 19:56:37.695105 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.695006    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k7ppv"]
May 26 19:56:37.695693 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.695340    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerName="registry"
May 26 19:56:37.695693 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.695357    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerName="registry"
May 26 19:56:37.695693 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.695427    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="13143c99-9864-4d4d-b7d8-077fa5e3475e" containerName="registry"
May 26 19:56:37.698127 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.698105    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.700823 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.700799    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 26 19:56:37.700823 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.700813    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b48kv\""
May 26 19:56:37.701893 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.701872    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 26 19:56:37.705037 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.704542    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k7ppv"]
May 26 19:56:37.814506 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.814466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.814688 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.814524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlbq4\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-kube-api-access-nlbq4\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.915022 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.914983    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbq4\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-kube-api-access-nlbq4\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.915188 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.915047    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.922901 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.922869    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:37.923035 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:37.922957    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbq4\" (UniqueName: \"kubernetes.io/projected/5736f464-e9bb-4d32-bbaf-9e023e46bba8-kube-api-access-nlbq4\") pod \"cert-manager-cainjector-68b757865b-k7ppv\" (UID: \"5736f464-e9bb-4d32-bbaf-9e023e46bba8\") " pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:38.007840 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:38.007781    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv"
May 26 19:56:38.133576 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:38.133545    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-k7ppv"]
May 26 19:56:38.136179 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:56:38.136149    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5736f464_e9bb_4d32_bbaf_9e023e46bba8.slice/crio-78449c501d5199a2053795490a83864347c1d7ea3fc50a033c025dd3bb7c5db4 WatchSource:0}: Error finding container 78449c501d5199a2053795490a83864347c1d7ea3fc50a033c025dd3bb7c5db4: Status 404 returned error can't find the container with id 78449c501d5199a2053795490a83864347c1d7ea3fc50a033c025dd3bb7c5db4
May 26 19:56:38.138048 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:38.138032    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:56:38.852541 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:38.852509    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv" event={"ID":"5736f464-e9bb-4d32-bbaf-9e023e46bba8","Type":"ContainerStarted","Data":"78449c501d5199a2053795490a83864347c1d7ea3fc50a033c025dd3bb7c5db4"}
May 26 19:56:42.864237 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:42.864196    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv" event={"ID":"5736f464-e9bb-4d32-bbaf-9e023e46bba8","Type":"ContainerStarted","Data":"eafea6a44ede63a7714883c670e9969dc2e9eecaf8aa291550929e4e86025430"}
May 26 19:56:42.879315 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:42.879254    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-k7ppv" podStartSLOduration=1.223024956 podStartE2EDuration="5.879234132s" podCreationTimestamp="2026-05-26 19:56:37 +0000 UTC" firstStartedPulling="2026-05-26 19:56:38.138187558 +0000 UTC m=+561.391259528" lastFinishedPulling="2026-05-26 19:56:42.794396735 +0000 UTC m=+566.047468704" observedRunningTime="2026-05-26 19:56:42.878619445 +0000 UTC m=+566.131691437" watchObservedRunningTime="2026-05-26 19:56:42.879234132 +0000 UTC m=+566.132306124"
May 26 19:56:53.011268 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.011229    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-r5kl6"]
May 26 19:56:53.014305 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.014285    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.016845 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.016824    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bz5hl\""
May 26 19:56:53.022758 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.022733    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-r5kl6"]
May 26 19:56:53.114452 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.114411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n466m\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-kube-api-access-n466m\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.114624 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.114475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-bound-sa-token\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.214891 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.214854    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n466m\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-kube-api-access-n466m\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.215089 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.214916    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-bound-sa-token\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.222755 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.222725    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-bound-sa-token\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.222892 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.222816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n466m\" (UniqueName: \"kubernetes.io/projected/3404734e-1cb7-4f32-a590-303a6e840ded-kube-api-access-n466m\") pod \"cert-manager-79c8d999ff-r5kl6\" (UID: \"3404734e-1cb7-4f32-a590-303a6e840ded\") " pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.324068 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.323980    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-r5kl6"
May 26 19:56:53.445579 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.445545    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-r5kl6"]
May 26 19:56:53.449977 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:56:53.449946    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3404734e_1cb7_4f32_a590_303a6e840ded.slice/crio-44aa1162568452bc0269428375444ff1eb004730ecd4c9d65ba92901690b3d03 WatchSource:0}: Error finding container 44aa1162568452bc0269428375444ff1eb004730ecd4c9d65ba92901690b3d03: Status 404 returned error can't find the container with id 44aa1162568452bc0269428375444ff1eb004730ecd4c9d65ba92901690b3d03
May 26 19:56:53.898418 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.898383    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-r5kl6" event={"ID":"3404734e-1cb7-4f32-a590-303a6e840ded","Type":"ContainerStarted","Data":"66b8f2ddbccfd45fd3129efa8b0663ab296d8e2360c7bdbcc90d2fa0f01f335d"}
May 26 19:56:53.898418 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.898420    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-r5kl6" event={"ID":"3404734e-1cb7-4f32-a590-303a6e840ded","Type":"ContainerStarted","Data":"44aa1162568452bc0269428375444ff1eb004730ecd4c9d65ba92901690b3d03"}
May 26 19:56:53.921876 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:56:53.921815    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-r5kl6" podStartSLOduration=1.9218015259999999 podStartE2EDuration="1.921801526s" podCreationTimestamp="2026-05-26 19:56:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:56:53.919817335 +0000 UTC m=+577.172889327" watchObservedRunningTime="2026-05-26 19:56:53.921801526 +0000 UTC m=+577.174873516"
May 26 19:57:22.715574 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.715536    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"]
May 26 19:57:22.717632 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.717611    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.721001 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.720975    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 19:57:22.721144 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.721016    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bc2rx\""
May 26 19:57:22.721144 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.721047    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 19:57:22.721144 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.720975    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 19:57:22.721314 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.721297    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 19:57:22.737087 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.737057    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"]
May 26 19:57:22.805608 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.805568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.805608 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.805606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.805827 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.805630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjz8\" (UniqueName: \"kubernetes.io/projected/97694e1a-d49c-4fa0-860d-27297972b82d-kube-api-access-bqjz8\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.906949 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.906916    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.907069 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.906955    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.907069 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.906978    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjz8\" (UniqueName: \"kubernetes.io/projected/97694e1a-d49c-4fa0-860d-27297972b82d-kube-api-access-bqjz8\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.909648 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.909623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.909760 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.909623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97694e1a-d49c-4fa0-860d-27297972b82d-webhook-cert\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:22.915036 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:22.915009    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjz8\" (UniqueName: \"kubernetes.io/projected/97694e1a-d49c-4fa0-860d-27297972b82d-kube-api-access-bqjz8\") pod \"opendatahub-operator-controller-manager-665f5b4546-bfqlc\" (UID: \"97694e1a-d49c-4fa0-860d-27297972b82d\") " pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:23.027737 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:23.027699    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:23.172075 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:23.172039    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"]
May 26 19:57:23.176232 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:57:23.176204    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97694e1a_d49c_4fa0_860d_27297972b82d.slice/crio-f78034920f1e7da5a7fe7672e678e9fbc5a8c2d18182d67932ffb1724b868422 WatchSource:0}: Error finding container f78034920f1e7da5a7fe7672e678e9fbc5a8c2d18182d67932ffb1724b868422: Status 404 returned error can't find the container with id f78034920f1e7da5a7fe7672e678e9fbc5a8c2d18182d67932ffb1724b868422
May 26 19:57:23.973097 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:23.973049    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc" event={"ID":"97694e1a-d49c-4fa0-860d-27297972b82d","Type":"ContainerStarted","Data":"f78034920f1e7da5a7fe7672e678e9fbc5a8c2d18182d67932ffb1724b868422"}
May 26 19:57:25.979620 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:25.979533    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc" event={"ID":"97694e1a-d49c-4fa0-860d-27297972b82d","Type":"ContainerStarted","Data":"cc976d4a0b7978a9f9e8d835f19753412db55c2f58a4b5802becb630077b5a1a"}
May 26 19:57:25.979980 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:25.979696    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:26.002737 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:26.002693    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc" podStartSLOduration=1.650954158 podStartE2EDuration="4.002680632s" podCreationTimestamp="2026-05-26 19:57:22 +0000 UTC" firstStartedPulling="2026-05-26 19:57:23.177801292 +0000 UTC m=+606.430873261" lastFinishedPulling="2026-05-26 19:57:25.529527766 +0000 UTC m=+608.782599735" observedRunningTime="2026-05-26 19:57:26.00135166 +0000 UTC m=+609.254423645" watchObservedRunningTime="2026-05-26 19:57:26.002680632 +0000 UTC m=+609.255752622"
May 26 19:57:36.985179 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:36.985100    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-665f5b4546-bfqlc"
May 26 19:57:42.769168 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.769128    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"]
May 26 19:57:42.772236 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.772216    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.775997 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.775970    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 26 19:57:42.776137 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.775970    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t5wqh\""
May 26 19:57:42.776137 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.776024    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 19:57:42.776137 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.776051    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 26 19:57:42.776137 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.776089    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 19:57:42.780971 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.780924    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"]
May 26 19:57:42.850717 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.850681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c058f8-805a-4f81-bb39-57352e62d809-tls-certs\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.850717 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.850721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lszvt\" (UniqueName: \"kubernetes.io/projected/e6c058f8-805a-4f81-bb39-57352e62d809-kube-api-access-lszvt\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.850953 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.850759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c058f8-805a-4f81-bb39-57352e62d809-tmp\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.951736 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.951687    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c058f8-805a-4f81-bb39-57352e62d809-tmp\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.951937 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.951774    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c058f8-805a-4f81-bb39-57352e62d809-tls-certs\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.951937 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.951805    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lszvt\" (UniqueName: \"kubernetes.io/projected/e6c058f8-805a-4f81-bb39-57352e62d809-kube-api-access-lszvt\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.954142 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.954111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c058f8-805a-4f81-bb39-57352e62d809-tmp\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.954267 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.954248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c058f8-805a-4f81-bb39-57352e62d809-tls-certs\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:42.960532 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:42.960505    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lszvt\" (UniqueName: \"kubernetes.io/projected/e6c058f8-805a-4f81-bb39-57352e62d809-kube-api-access-lszvt\") pod \"kube-auth-proxy-6ff7c56cdc-mffrn\" (UID: \"e6c058f8-805a-4f81-bb39-57352e62d809\") " pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:43.082253 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:43.082164    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"
May 26 19:57:43.215660 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:43.215633    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn"]
May 26 19:57:43.218100 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:57:43.218069    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c058f8_805a_4f81_bb39_57352e62d809.slice/crio-655aae2fb01a00b7a46645b588eae95b4c99e38992077ca97b8e9f2c139de39a WatchSource:0}: Error finding container 655aae2fb01a00b7a46645b588eae95b4c99e38992077ca97b8e9f2c139de39a: Status 404 returned error can't find the container with id 655aae2fb01a00b7a46645b588eae95b4c99e38992077ca97b8e9f2c139de39a
May 26 19:57:44.030110 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:44.030054    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn" event={"ID":"e6c058f8-805a-4f81-bb39-57352e62d809","Type":"ContainerStarted","Data":"655aae2fb01a00b7a46645b588eae95b4c99e38992077ca97b8e9f2c139de39a"}
May 26 19:57:45.573970 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.573934    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gnh7d"]
May 26 19:57:45.576958 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.576938    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:45.579526 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.579500    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 26 19:57:45.579657 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.579622    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fd54j\""
May 26 19:57:45.584553 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.584528    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gnh7d"]
May 26 19:57:45.674175 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.674133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhj48\" (UniqueName: \"kubernetes.io/projected/ee549b8c-8e05-413d-8f25-12655add3335-kube-api-access-hhj48\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:45.674369 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.674183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:45.774796 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.774750    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:45.774964 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.774844    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhj48\" (UniqueName: \"kubernetes.io/projected/ee549b8c-8e05-413d-8f25-12655add3335-kube-api-access-hhj48\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:45.774964 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:45.774899    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 26 19:57:45.775036 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:45.774978    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert podName:ee549b8c-8e05-413d-8f25-12655add3335 nodeName:}" failed. No retries permitted until 2026-05-26 19:57:46.274960626 +0000 UTC m=+629.528032596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert") pod "odh-model-controller-858dbf95b8-gnh7d" (UID: "ee549b8c-8e05-413d-8f25-12655add3335") : secret "odh-model-controller-webhook-cert" not found
May 26 19:57:45.783664 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:45.783639    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhj48\" (UniqueName: \"kubernetes.io/projected/ee549b8c-8e05-413d-8f25-12655add3335-kube-api-access-hhj48\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:46.279257 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:46.279203    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:46.283069 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:46.283031    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee549b8c-8e05-413d-8f25-12655add3335-cert\") pod \"odh-model-controller-858dbf95b8-gnh7d\" (UID: \"ee549b8c-8e05-413d-8f25-12655add3335\") " pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:46.488026 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:46.487994    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:46.742100 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:46.742069    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gnh7d"]
May 26 19:57:46.745351 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:57:46.745296    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee549b8c_8e05_413d_8f25_12655add3335.slice/crio-afa4562014a3cea0bef462d31ee4e1ca46067b1f50f05dee30dc21b55657e348 WatchSource:0}: Error finding container afa4562014a3cea0bef462d31ee4e1ca46067b1f50f05dee30dc21b55657e348: Status 404 returned error can't find the container with id afa4562014a3cea0bef462d31ee4e1ca46067b1f50f05dee30dc21b55657e348
May 26 19:57:47.040164 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:47.040124    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn" event={"ID":"e6c058f8-805a-4f81-bb39-57352e62d809","Type":"ContainerStarted","Data":"77dfc9945f31e8bdc78b07de54d7f8ab57c322aa3840c6abb58582964417b671"}
May 26 19:57:47.041305 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:47.041271    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" event={"ID":"ee549b8c-8e05-413d-8f25-12655add3335","Type":"ContainerStarted","Data":"afa4562014a3cea0bef462d31ee4e1ca46067b1f50f05dee30dc21b55657e348"}
May 26 19:57:47.059252 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:47.059205    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff7c56cdc-mffrn" podStartSLOduration=1.607063941 podStartE2EDuration="5.05919s" podCreationTimestamp="2026-05-26 19:57:42 +0000 UTC" firstStartedPulling="2026-05-26 19:57:43.220590115 +0000 UTC m=+626.473662098" lastFinishedPulling="2026-05-26 19:57:46.672716187 +0000 UTC m=+629.925788157" observedRunningTime="2026-05-26 19:57:47.05712813 +0000 UTC m=+630.310200151" watchObservedRunningTime="2026-05-26 19:57:47.05919 +0000 UTC m=+630.312261990"
May 26 19:57:50.053013 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:50.052978    2573 generic.go:358] "Generic (PLEG): container finished" podID="ee549b8c-8e05-413d-8f25-12655add3335" containerID="c22650086a9532e6de7cf02bcbb0448b5199272df980c94e4be428647c3b405e" exitCode=1
May 26 19:57:50.053419 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:50.053038    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" event={"ID":"ee549b8c-8e05-413d-8f25-12655add3335","Type":"ContainerDied","Data":"c22650086a9532e6de7cf02bcbb0448b5199272df980c94e4be428647c3b405e"}
May 26 19:57:50.053419 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:50.053354    2573 scope.go:117] "RemoveContainer" containerID="c22650086a9532e6de7cf02bcbb0448b5199272df980c94e4be428647c3b405e"
May 26 19:57:51.058970 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:51.058936    2573 generic.go:358] "Generic (PLEG): container finished" podID="ee549b8c-8e05-413d-8f25-12655add3335" containerID="bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa" exitCode=1
May 26 19:57:51.059449 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:51.059018    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" event={"ID":"ee549b8c-8e05-413d-8f25-12655add3335","Type":"ContainerDied","Data":"bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa"}
May 26 19:57:51.059449 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:51.059058    2573 scope.go:117] "RemoveContainer" containerID="c22650086a9532e6de7cf02bcbb0448b5199272df980c94e4be428647c3b405e"
May 26 19:57:51.059449 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:51.059255    2573 scope.go:117] "RemoveContainer" containerID="bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa"
May 26 19:57:51.059604 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:51.059485    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gnh7d_opendatahub(ee549b8c-8e05-413d-8f25-12655add3335)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" podUID="ee549b8c-8e05-413d-8f25-12655add3335"
May 26 19:57:52.063808 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.063773    2573 scope.go:117] "RemoveContainer" containerID="bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa"
May 26 19:57:52.064186 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:52.063990    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gnh7d_opendatahub(ee549b8c-8e05-413d-8f25-12655add3335)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" podUID="ee549b8c-8e05-413d-8f25-12655add3335"
May 26 19:57:52.468004 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.467925    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-swsl9"]
May 26 19:57:52.471081 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.471060    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:52.473914 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.473888    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 26 19:57:52.474066 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.473949    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x72v4\""
May 26 19:57:52.484517 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.484489    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-swsl9"]
May 26 19:57:52.527185 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.527148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl542\" (UniqueName: \"kubernetes.io/projected/21eb5e72-acd6-4735-8bc4-64f976b162ae-kube-api-access-bl542\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:52.527389 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.527195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:52.628370 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.628306    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl542\" (UniqueName: \"kubernetes.io/projected/21eb5e72-acd6-4735-8bc4-64f976b162ae-kube-api-access-bl542\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:52.628542 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.628394    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:52.628542 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:52.628518    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 26 19:57:52.628626 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:52.628570    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert podName:21eb5e72-acd6-4735-8bc4-64f976b162ae nodeName:}" failed. No retries permitted until 2026-05-26 19:57:53.128554063 +0000 UTC m=+636.381626033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert") pod "kserve-controller-manager-856948b99f-swsl9" (UID: "21eb5e72-acd6-4735-8bc4-64f976b162ae") : secret "kserve-webhook-server-cert" not found
May 26 19:57:52.643178 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:52.643137    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl542\" (UniqueName: \"kubernetes.io/projected/21eb5e72-acd6-4735-8bc4-64f976b162ae-kube-api-access-bl542\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:53.132488 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:53.132445    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:53.135040 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:53.135009    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21eb5e72-acd6-4735-8bc4-64f976b162ae-cert\") pod \"kserve-controller-manager-856948b99f-swsl9\" (UID: \"21eb5e72-acd6-4735-8bc4-64f976b162ae\") " pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:53.382413 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:53.382373    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:53.508614 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:53.508578    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-swsl9"]
May 26 19:57:53.512650 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:57:53.512623    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21eb5e72_acd6_4735_8bc4_64f976b162ae.slice/crio-1ab59fc10924d4e7639062eb4cdd522961dc82166ddccfe22d3f7e3feebe6e5c WatchSource:0}: Error finding container 1ab59fc10924d4e7639062eb4cdd522961dc82166ddccfe22d3f7e3feebe6e5c: Status 404 returned error can't find the container with id 1ab59fc10924d4e7639062eb4cdd522961dc82166ddccfe22d3f7e3feebe6e5c
May 26 19:57:54.069970 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:54.069934    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9" event={"ID":"21eb5e72-acd6-4735-8bc4-64f976b162ae","Type":"ContainerStarted","Data":"1ab59fc10924d4e7639062eb4cdd522961dc82166ddccfe22d3f7e3feebe6e5c"}
May 26 19:57:56.488189 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:56.488162    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:57:56.494088 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:56.488544    2573 scope.go:117] "RemoveContainer" containerID="bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa"
May 26 19:57:56.494088 ip-10-0-141-124 kubenswrapper[2573]: E0526 19:57:56.488710    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gnh7d_opendatahub(ee549b8c-8e05-413d-8f25-12655add3335)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" podUID="ee549b8c-8e05-413d-8f25-12655add3335"
May 26 19:57:57.204176 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.204121    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"]
May 26 19:57:57.210179 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.210129    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.212863 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.212832    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 26 19:57:57.213008 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.212835    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 26 19:57:57.213008 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.212844    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xl58b\""
May 26 19:57:57.219791 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.219750    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"]
May 26 19:57:57.270806 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.270769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16873e39-1c05-4d1b-a752-766b0a0289bc-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.270985 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.270845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8md\" (UniqueName: \"kubernetes.io/projected/16873e39-1c05-4d1b-a752-766b0a0289bc-kube-api-access-mh8md\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.371395 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.371353    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16873e39-1c05-4d1b-a752-766b0a0289bc-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.371595 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.371433    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8md\" (UniqueName: \"kubernetes.io/projected/16873e39-1c05-4d1b-a752-766b0a0289bc-kube-api-access-mh8md\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.374261 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.374226    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16873e39-1c05-4d1b-a752-766b0a0289bc-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.383037 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.383004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8md\" (UniqueName: \"kubernetes.io/projected/16873e39-1c05-4d1b-a752-766b0a0289bc-kube-api-access-mh8md\") pod \"servicemesh-operator3-55f49c5f94-pq69r\" (UID: \"16873e39-1c05-4d1b-a752-766b0a0289bc\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.523318 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.523279    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:57:57.762557 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:57.762519    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"]
May 26 19:57:57.767695 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:57:57.767635    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16873e39_1c05_4d1b_a752_766b0a0289bc.slice/crio-9eb109665666bbb95d70a038ff87f2055dad43a963bcf082074b60f68c78ce10 WatchSource:0}: Error finding container 9eb109665666bbb95d70a038ff87f2055dad43a963bcf082074b60f68c78ce10: Status 404 returned error can't find the container with id 9eb109665666bbb95d70a038ff87f2055dad43a963bcf082074b60f68c78ce10
May 26 19:57:58.081818 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:58.081724    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9" event={"ID":"21eb5e72-acd6-4735-8bc4-64f976b162ae","Type":"ContainerStarted","Data":"3a2dd16e95f9c020dae107729f91505ee04ad6fd76e9d9b13f069d75828a7433"}
May 26 19:57:58.081975 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:58.081834    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:57:58.082961 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:58.082936    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r" event={"ID":"16873e39-1c05-4d1b-a752-766b0a0289bc","Type":"ContainerStarted","Data":"9eb109665666bbb95d70a038ff87f2055dad43a963bcf082074b60f68c78ce10"}
May 26 19:57:58.104298 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:57:58.104241    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9" podStartSLOduration=1.944194595 podStartE2EDuration="6.104227276s" podCreationTimestamp="2026-05-26 19:57:52 +0000 UTC" firstStartedPulling="2026-05-26 19:57:53.514034114 +0000 UTC m=+636.767106083" lastFinishedPulling="2026-05-26 19:57:57.674066777 +0000 UTC m=+640.927138764" observedRunningTime="2026-05-26 19:57:58.102490266 +0000 UTC m=+641.355562258" watchObservedRunningTime="2026-05-26 19:57:58.104227276 +0000 UTC m=+641.357299291"
May 26 19:58:01.094537 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:01.094495    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r" event={"ID":"16873e39-1c05-4d1b-a752-766b0a0289bc","Type":"ContainerStarted","Data":"4fe038e4fef1f5c3b97545194a72cef764c95e95c86eb57cca49d04aad327509"}
May 26 19:58:01.094927 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:01.094596    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:58:01.115007 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:01.114950    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r" podStartSLOduration=1.383700568 podStartE2EDuration="4.114929269s" podCreationTimestamp="2026-05-26 19:57:57 +0000 UTC" firstStartedPulling="2026-05-26 19:57:57.770853035 +0000 UTC m=+641.023925004" lastFinishedPulling="2026-05-26 19:58:00.502081733 +0000 UTC m=+643.755153705" observedRunningTime="2026-05-26 19:58:01.112921991 +0000 UTC m=+644.365993982" watchObservedRunningTime="2026-05-26 19:58:01.114929269 +0000 UTC m=+644.368001262"
May 26 19:58:06.488168 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:06.488133    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:58:06.488665 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:06.488636    2573 scope.go:117] "RemoveContainer" containerID="bc5688e0cabf14f9b71b0b9ded8523cf906f67282ce1d44c56000508aa5427fa"
May 26 19:58:07.116123 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:07.116039    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" event={"ID":"ee549b8c-8e05-413d-8f25-12655add3335","Type":"ContainerStarted","Data":"16c2364e03f3baa2f8b83c22dcb0a676d46fa7499df4541d4f36654fb39ceb1a"}
May 26 19:58:07.116276 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:07.116253    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:58:07.132487 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:07.132420    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d" podStartSLOduration=2.105849745 podStartE2EDuration="22.132404248s" podCreationTimestamp="2026-05-26 19:57:45 +0000 UTC" firstStartedPulling="2026-05-26 19:57:46.747131614 +0000 UTC m=+630.000203597" lastFinishedPulling="2026-05-26 19:58:06.773686128 +0000 UTC m=+650.026758100" observedRunningTime="2026-05-26 19:58:07.131524343 +0000 UTC m=+650.384596334" watchObservedRunningTime="2026-05-26 19:58:07.132404248 +0000 UTC m=+650.385476239"
May 26 19:58:12.100802 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:12.100758    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pq69r"
May 26 19:58:13.759938 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.759901    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"]
May 26 19:58:13.763345 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.763311    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.766044 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.766019    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 19:58:13.766044 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.766035    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 26 19:58:13.766267 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.766123    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jmt6d\""
May 26 19:58:13.766267 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.766195    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 26 19:58:13.766267 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.766247    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 26 19:58:13.773514 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.773488    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"]
May 26 19:58:13.910360 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nq2\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-kube-api-access-28nq2\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910530 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86561178-4d56-431b-bfc9-52cd2e38f097-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910530 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910530 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910634 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910634 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:13.910634 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:13.910610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011235 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011135    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011235 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011195    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011235 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011212    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011235 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011239    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28nq2\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-kube-api-access-28nq2\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011651 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011263    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86561178-4d56-431b-bfc9-52cd2e38f097-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011651 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011310    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011651 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011368    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.011995 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.011969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.013648 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.013625    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86561178-4d56-431b-bfc9-52cd2e38f097-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.014104 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.014077    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.014202 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.014103    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.014202 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.014112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86561178-4d56-431b-bfc9-52cd2e38f097-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.018879 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.018847    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.019538 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.019512    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nq2\" (UniqueName: \"kubernetes.io/projected/86561178-4d56-431b-bfc9-52cd2e38f097-kube-api-access-28nq2\") pod \"istiod-openshift-gateway-798958bb55-gvznc\" (UID: \"86561178-4d56-431b-bfc9-52cd2e38f097\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.072708 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.072654    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:14.220694 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:14.220656    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"]
May 26 19:58:14.223403 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:58:14.223371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86561178_4d56_431b_bfc9_52cd2e38f097.slice/crio-3f2c505712e318d343a0b10b9653b67b8564a0c8fe99e5bae372a5991e87992e WatchSource:0}: Error finding container 3f2c505712e318d343a0b10b9653b67b8564a0c8fe99e5bae372a5991e87992e: Status 404 returned error can't find the container with id 3f2c505712e318d343a0b10b9653b67b8564a0c8fe99e5bae372a5991e87992e
May 26 19:58:15.143403 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:15.143355    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc" event={"ID":"86561178-4d56-431b-bfc9-52cd2e38f097","Type":"ContainerStarted","Data":"3f2c505712e318d343a0b10b9653b67b8564a0c8fe99e5bae372a5991e87992e"}
May 26 19:58:17.025177 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:17.025116    2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:58:17.025502 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:17.025223    2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:58:17.153512 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:17.153467    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc" event={"ID":"86561178-4d56-431b-bfc9-52cd2e38f097","Type":"ContainerStarted","Data":"33fa63730bd73b8698204f20dfaad201466e26ac101110962403cedfce90a017"}
May 26 19:58:17.153709 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:17.153554    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:17.173865 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:17.173814    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc" podStartSLOduration=1.374881814 podStartE2EDuration="4.173798517s" podCreationTimestamp="2026-05-26 19:58:13 +0000 UTC" firstStartedPulling="2026-05-26 19:58:14.225919758 +0000 UTC m=+657.478991729" lastFinishedPulling="2026-05-26 19:58:17.024836448 +0000 UTC m=+660.277908432" observedRunningTime="2026-05-26 19:58:17.172501332 +0000 UTC m=+660.425573315" watchObservedRunningTime="2026-05-26 19:58:17.173798517 +0000 UTC m=+660.426870508"
May 26 19:58:18.121607 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:18.121573    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-gnh7d"
May 26 19:58:18.159129 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:18.159061    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-gvznc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 26 19:58:18.159406 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:18.159377    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc" podUID="86561178-4d56-431b-bfc9-52cd2e38f097" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:58:21.159133 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:21.159092    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gvznc"
May 26 19:58:29.092152 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:58:29.092113    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-swsl9"
May 26 19:59:13.736519 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.736436    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-m5d65"]
May 26 19:59:13.738317 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.738299    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:13.740914 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.740892    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 19:59:13.741051 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.740951    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 19:59:13.741996 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.741975    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7fkpc\""
May 26 19:59:13.751532 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.751506    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-m5d65"]
May 26 19:59:13.905469 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:13.905426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jzv\" (UniqueName: \"kubernetes.io/projected/1634f0ee-38e2-4a0b-bd5b-1f3168fa679c-kube-api-access-n7jzv\") pod \"authorino-operator-657f44b778-m5d65\" (UID: \"1634f0ee-38e2-4a0b-bd5b-1f3168fa679c\") " pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:14.006714 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:14.006673    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jzv\" (UniqueName: \"kubernetes.io/projected/1634f0ee-38e2-4a0b-bd5b-1f3168fa679c-kube-api-access-n7jzv\") pod \"authorino-operator-657f44b778-m5d65\" (UID: \"1634f0ee-38e2-4a0b-bd5b-1f3168fa679c\") " pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:14.024695 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:14.024658    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jzv\" (UniqueName: \"kubernetes.io/projected/1634f0ee-38e2-4a0b-bd5b-1f3168fa679c-kube-api-access-n7jzv\") pod \"authorino-operator-657f44b778-m5d65\" (UID: \"1634f0ee-38e2-4a0b-bd5b-1f3168fa679c\") " pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:14.047987 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:14.047947    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:14.184536 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:14.184508    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-m5d65"]
May 26 19:59:14.186862 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:59:14.186833    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1634f0ee_38e2_4a0b_bd5b_1f3168fa679c.slice/crio-bbd30c1a55443e3ace67d5a79e1d5fb2b2ee0986c1e2ee873c8d4fe144d79789 WatchSource:0}: Error finding container bbd30c1a55443e3ace67d5a79e1d5fb2b2ee0986c1e2ee873c8d4fe144d79789: Status 404 returned error can't find the container with id bbd30c1a55443e3ace67d5a79e1d5fb2b2ee0986c1e2ee873c8d4fe144d79789
May 26 19:59:14.323141 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:14.323056    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-m5d65" event={"ID":"1634f0ee-38e2-4a0b-bd5b-1f3168fa679c","Type":"ContainerStarted","Data":"bbd30c1a55443e3ace67d5a79e1d5fb2b2ee0986c1e2ee873c8d4fe144d79789"}
May 26 19:59:16.329620 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:16.329579    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-m5d65" event={"ID":"1634f0ee-38e2-4a0b-bd5b-1f3168fa679c","Type":"ContainerStarted","Data":"9a73f5475eebe09b9652c8070b453e78e6bcb249e2ffde425eed270ec5a370ca"}
May 26 19:59:16.330002 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:16.329699    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:16.351723 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:16.351609    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-m5d65" podStartSLOduration=1.45035732 podStartE2EDuration="3.351593098s" podCreationTimestamp="2026-05-26 19:59:13 +0000 UTC" firstStartedPulling="2026-05-26 19:59:14.188700017 +0000 UTC m=+717.441771985" lastFinishedPulling="2026-05-26 19:59:16.089935781 +0000 UTC m=+719.343007763" observedRunningTime="2026-05-26 19:59:16.349365149 +0000 UTC m=+719.602437137" watchObservedRunningTime="2026-05-26 19:59:16.351593098 +0000 UTC m=+719.604665090"
May 26 19:59:26.785998 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.785952    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 19:59:26.789634 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.789596    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.792156 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.792132    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sd4wx\""
May 26 19:59:26.802106 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.802082    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 19:59:26.806823 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.806789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.806954 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.806850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lswlq\" (UniqueName: \"kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.907262 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.907228    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.907262 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.907275    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lswlq\" (UniqueName: \"kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.907678 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.907652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:26.917745 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:26.917716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lswlq\" (UniqueName: \"kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f8ck8\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:27.100262 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:27.100162    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:27.230014 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:27.229957    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 19:59:27.232425 ip-10-0-141-124 kubenswrapper[2573]: W0526 19:59:27.232396    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb63c5e3_930d_4599_ad92_87d0c2536d57.slice/crio-991c523c34e6af1dc1d038f5af80fdca75ec19ac1614fcba9374f5141e9c68a9 WatchSource:0}: Error finding container 991c523c34e6af1dc1d038f5af80fdca75ec19ac1614fcba9374f5141e9c68a9: Status 404 returned error can't find the container with id 991c523c34e6af1dc1d038f5af80fdca75ec19ac1614fcba9374f5141e9c68a9
May 26 19:59:27.335755 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:27.335727    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-m5d65"
May 26 19:59:27.363024 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:27.362944    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" event={"ID":"db63c5e3-930d-4599-ad92-87d0c2536d57","Type":"ContainerStarted","Data":"991c523c34e6af1dc1d038f5af80fdca75ec19ac1614fcba9374f5141e9c68a9"}
May 26 19:59:31.378086 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:31.378045    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" event={"ID":"db63c5e3-930d-4599-ad92-87d0c2536d57","Type":"ContainerStarted","Data":"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"}
May 26 19:59:31.378585 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:31.378176    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 19:59:31.398210 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:31.398155    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" podStartSLOduration=1.417489655 podStartE2EDuration="5.398137866s" podCreationTimestamp="2026-05-26 19:59:26 +0000 UTC" firstStartedPulling="2026-05-26 19:59:27.234834946 +0000 UTC m=+730.487906920" lastFinishedPulling="2026-05-26 19:59:31.215483162 +0000 UTC m=+734.468555131" observedRunningTime="2026-05-26 19:59:31.396605541 +0000 UTC m=+734.649677532" watchObservedRunningTime="2026-05-26 19:59:31.398137866 +0000 UTC m=+734.651209857"
May 26 19:59:42.383223 ip-10-0-141-124 kubenswrapper[2573]: I0526 19:59:42.383191    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 20:00:37.332741 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.332650    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:00:37.334823 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.334803    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:37.337730 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.337705    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 20:00:37.337730 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.337719    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m9p4x\""
May 26 20:00:37.346722 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.346693    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:00:37.441738 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.441698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxzn\" (UniqueName: \"kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn\") pod \"maas-controller-5b48b7668c-9vbst\" (UID: \"3ee4e4ef-cbf0-4835-a52b-59497d478345\") " pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:37.542557 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.542521    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxzn\" (UniqueName: \"kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn\") pod \"maas-controller-5b48b7668c-9vbst\" (UID: \"3ee4e4ef-cbf0-4835-a52b-59497d478345\") " pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:37.550885 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.550850    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxzn\" (UniqueName: \"kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn\") pod \"maas-controller-5b48b7668c-9vbst\" (UID: \"3ee4e4ef-cbf0-4835-a52b-59497d478345\") " pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:37.647582 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.647499    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:37.773961 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:37.773921    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:00:37.777372 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:00:37.777337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee4e4ef_cbf0_4835_a52b_59497d478345.slice/crio-a95106d4145d4fa877a7c6cb23d71875dffcf836d91eb63921265d8951b11f0a WatchSource:0}: Error finding container a95106d4145d4fa877a7c6cb23d71875dffcf836d91eb63921265d8951b11f0a: Status 404 returned error can't find the container with id a95106d4145d4fa877a7c6cb23d71875dffcf836d91eb63921265d8951b11f0a
May 26 20:00:38.585777 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:38.585734    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-9vbst" event={"ID":"3ee4e4ef-cbf0-4835-a52b-59497d478345","Type":"ContainerStarted","Data":"a95106d4145d4fa877a7c6cb23d71875dffcf836d91eb63921265d8951b11f0a"}
May 26 20:00:40.593832 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:40.593797    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-9vbst" event={"ID":"3ee4e4ef-cbf0-4835-a52b-59497d478345","Type":"ContainerStarted","Data":"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"}
May 26 20:00:40.594205 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:40.593908    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:00:40.617818 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:40.617761    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5b48b7668c-9vbst" podStartSLOduration=1.206991507 podStartE2EDuration="3.617743712s" podCreationTimestamp="2026-05-26 20:00:37 +0000 UTC" firstStartedPulling="2026-05-26 20:00:37.778986204 +0000 UTC m=+801.032058173" lastFinishedPulling="2026-05-26 20:00:40.189738406 +0000 UTC m=+803.442810378" observedRunningTime="2026-05-26 20:00:40.616121295 +0000 UTC m=+803.869193290" watchObservedRunningTime="2026-05-26 20:00:40.617743712 +0000 UTC m=+803.870815703"
May 26 20:00:51.602670 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:00:51.602632    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:01:48.865535 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.865498    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"]
May 26 20:01:48.868983 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.868960    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.871937 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.871913    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 20:01:48.872046 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.871967    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 20:01:48.873116 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.873092    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 26 20:01:48.873252 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.873141    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ld84t\""
May 26 20:01:48.879817 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.879792    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"]
May 26 20:01:48.999005 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.998959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.999190 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.999053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.999190 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.999086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ce2a52-c54b-4646-bf0e-6754971714e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.999190 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.999112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.999295 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.999198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:48.999295 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:48.999231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlqh\" (UniqueName: \"kubernetes.io/projected/57ce2a52-c54b-4646-bf0e-6754971714e4-kube-api-access-5hlqh\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100117 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100079    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100272 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100122    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100272 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100242    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ce2a52-c54b-4646-bf0e-6754971714e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100399 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100297    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100460 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100397    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100460 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100446    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlqh\" (UniqueName: \"kubernetes.io/projected/57ce2a52-c54b-4646-bf0e-6754971714e4-kube-api-access-5hlqh\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100597 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100576    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100681 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.100738 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.100695    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.102519 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.102498    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ce2a52-c54b-4646-bf0e-6754971714e4-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.102765 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.102746    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ce2a52-c54b-4646-bf0e-6754971714e4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.108679 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.108649    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlqh\" (UniqueName: \"kubernetes.io/projected/57ce2a52-c54b-4646-bf0e-6754971714e4-kube-api-access-5hlqh\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c\" (UID: \"57ce2a52-c54b-4646-bf0e-6754971714e4\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.179354 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.179249    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:01:49.336844 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.336790    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"]
May 26 20:01:49.337163 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.337060    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:01:49.824279 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:49.824234    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c" event={"ID":"57ce2a52-c54b-4646-bf0e-6754971714e4","Type":"ContainerStarted","Data":"aa4212b89d083325ffb3fa382d6b9c6ffd6d234ec2d651013b43f1f4275e66a1"}
May 26 20:01:55.854184 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:01:55.854144    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c" event={"ID":"57ce2a52-c54b-4646-bf0e-6754971714e4","Type":"ContainerStarted","Data":"a488121c94a39e0e47626ae62069e21f8cf4a1513e51312a2e760e5cba252302"}
May 26 20:02:01.875868 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:01.875830    2573 generic.go:358] "Generic (PLEG): container finished" podID="57ce2a52-c54b-4646-bf0e-6754971714e4" containerID="a488121c94a39e0e47626ae62069e21f8cf4a1513e51312a2e760e5cba252302" exitCode=0
May 26 20:02:01.876356 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:01.875904    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c" event={"ID":"57ce2a52-c54b-4646-bf0e-6754971714e4","Type":"ContainerDied","Data":"a488121c94a39e0e47626ae62069e21f8cf4a1513e51312a2e760e5cba252302"}
May 26 20:02:03.884381 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:03.884318    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c" event={"ID":"57ce2a52-c54b-4646-bf0e-6754971714e4","Type":"ContainerStarted","Data":"e440743ca32b22128d585a6adb2c302ebf6c841d27db8f69206a83aa69fcf621"}
May 26 20:02:03.884756 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:03.884568    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:02:03.904133 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:03.904065    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c" podStartSLOduration=1.981238325 podStartE2EDuration="15.904050026s" podCreationTimestamp="2026-05-26 20:01:48 +0000 UTC" firstStartedPulling="2026-05-26 20:01:49.337396037 +0000 UTC m=+872.590468005" lastFinishedPulling="2026-05-26 20:02:03.260207734 +0000 UTC m=+886.513279706" observedRunningTime="2026-05-26 20:02:03.903589145 +0000 UTC m=+887.156661136" watchObservedRunningTime="2026-05-26 20:02:03.904050026 +0000 UTC m=+887.157122015"
May 26 20:02:14.900961 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:14.900924    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c"
May 26 20:02:49.967664 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:49.967619    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"]
May 26 20:02:49.970361 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:49.970313    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:49.973069 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:49.973044    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 26 20:02:49.983316 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:49.983288    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"]
May 26 20:02:50.034374 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.034559 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87978cbd-74f7-42d8-b78b-5051fc3849a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.034559 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.034559 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ggb9\" (UniqueName: \"kubernetes.io/projected/87978cbd-74f7-42d8-b78b-5051fc3849a4-kube-api-access-9ggb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.034689 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.034689 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.034598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135140 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135102    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135158    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87978cbd-74f7-42d8-b78b-5051fc3849a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135191    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135229    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ggb9\" (UniqueName: \"kubernetes.io/projected/87978cbd-74f7-42d8-b78b-5051fc3849a4-kube-api-access-9ggb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135274    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135309    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135604 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.135678 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.135659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.136082 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.136051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.137945 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.137918    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87978cbd-74f7-42d8-b78b-5051fc3849a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.138032 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.138005    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87978cbd-74f7-42d8-b78b-5051fc3849a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.143631 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.143607    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ggb9\" (UniqueName: \"kubernetes.io/projected/87978cbd-74f7-42d8-b78b-5051fc3849a4-kube-api-access-9ggb9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4\" (UID: \"87978cbd-74f7-42d8-b78b-5051fc3849a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.280901 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.280855    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:50.420784 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:50.420619    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"]
May 26 20:02:50.430604 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:02:50.430568    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87978cbd_74f7_42d8_b78b_5051fc3849a4.slice/crio-b3c9da1761176c07c455aff134bf1e43288752a47140838691c888a38b936de0 WatchSource:0}: Error finding container b3c9da1761176c07c455aff134bf1e43288752a47140838691c888a38b936de0: Status 404 returned error can't find the container with id b3c9da1761176c07c455aff134bf1e43288752a47140838691c888a38b936de0
May 26 20:02:51.045232 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:51.045192    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4" event={"ID":"87978cbd-74f7-42d8-b78b-5051fc3849a4","Type":"ContainerStarted","Data":"55d1eb5c246ca6776298d61055860d2e1cfa15f62767dae2b2de3e897bcdbdfb"}
May 26 20:02:51.045620 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:51.045238    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4" event={"ID":"87978cbd-74f7-42d8-b78b-5051fc3849a4","Type":"ContainerStarted","Data":"b3c9da1761176c07c455aff134bf1e43288752a47140838691c888a38b936de0"}
May 26 20:02:57.066174 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:57.066136    2573 generic.go:358] "Generic (PLEG): container finished" podID="87978cbd-74f7-42d8-b78b-5051fc3849a4" containerID="55d1eb5c246ca6776298d61055860d2e1cfa15f62767dae2b2de3e897bcdbdfb" exitCode=0
May 26 20:02:57.067526 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:57.066202    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4" event={"ID":"87978cbd-74f7-42d8-b78b-5051fc3849a4","Type":"ContainerDied","Data":"55d1eb5c246ca6776298d61055860d2e1cfa15f62767dae2b2de3e897bcdbdfb"}
May 26 20:02:58.070509 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:58.070472    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4" event={"ID":"87978cbd-74f7-42d8-b78b-5051fc3849a4","Type":"ContainerStarted","Data":"0533d4e765707acf4a951a1b04678c724c5f1e5590d4910367e438ada9ed15cb"}
May 26 20:02:58.070895 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:58.070808    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:02:58.110592 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:02:58.110500    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4" podStartSLOduration=8.72860619 podStartE2EDuration="9.110483135s" podCreationTimestamp="2026-05-26 20:02:49 +0000 UTC" firstStartedPulling="2026-05-26 20:02:57.066787846 +0000 UTC m=+940.319859814" lastFinishedPulling="2026-05-26 20:02:57.44866479 +0000 UTC m=+940.701736759" observedRunningTime="2026-05-26 20:02:58.110027856 +0000 UTC m=+941.363099846" watchObservedRunningTime="2026-05-26 20:02:58.110483135 +0000 UTC m=+941.363555127"
May 26 20:03:09.086903 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:03:09.086870    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4"
May 26 20:04:25.006104 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.006062    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:04:25.006698 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.006316    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5b48b7668c-9vbst" podUID="3ee4e4ef-cbf0-4835-a52b-59497d478345" containerName="manager" containerID="cri-o://f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c" gracePeriod=30
May 26 20:04:25.256765 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.256709    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:04:25.324288 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.324257    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfxzn\" (UniqueName: \"kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn\") pod \"3ee4e4ef-cbf0-4835-a52b-59497d478345\" (UID: \"3ee4e4ef-cbf0-4835-a52b-59497d478345\") "
May 26 20:04:25.326507 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.326480    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn" (OuterVolumeSpecName: "kube-api-access-jfxzn") pod "3ee4e4ef-cbf0-4835-a52b-59497d478345" (UID: "3ee4e4ef-cbf0-4835-a52b-59497d478345"). InnerVolumeSpecName "kube-api-access-jfxzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:04:25.358810 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.358779    2573 generic.go:358] "Generic (PLEG): container finished" podID="3ee4e4ef-cbf0-4835-a52b-59497d478345" containerID="f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c" exitCode=0
May 26 20:04:25.358979 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.358841    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-9vbst"
May 26 20:04:25.358979 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.358876    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-9vbst" event={"ID":"3ee4e4ef-cbf0-4835-a52b-59497d478345","Type":"ContainerDied","Data":"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"}
May 26 20:04:25.358979 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.358925    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-9vbst" event={"ID":"3ee4e4ef-cbf0-4835-a52b-59497d478345","Type":"ContainerDied","Data":"a95106d4145d4fa877a7c6cb23d71875dffcf836d91eb63921265d8951b11f0a"}
May 26 20:04:25.358979 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.358947    2573 scope.go:117] "RemoveContainer" containerID="f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"
May 26 20:04:25.367833 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.367809    2573 scope.go:117] "RemoveContainer" containerID="f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"
May 26 20:04:25.368111 ip-10-0-141-124 kubenswrapper[2573]: E0526 20:04:25.368089    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c\": container with ID starting with f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c not found: ID does not exist" containerID="f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"
May 26 20:04:25.368156 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.368121    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c"} err="failed to get container status \"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c\": rpc error: code = NotFound desc = could not find container \"f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c\": container with ID starting with f884154d2678913c7c86849f97128edf88f97ee2aef801ca188734a549c9760c not found: ID does not exist"
May 26 20:04:25.383268 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.381608    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:04:25.388343 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.388303    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-9vbst"]
May 26 20:04:25.425763 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:25.425718    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfxzn\" (UniqueName: \"kubernetes.io/projected/3ee4e4ef-cbf0-4835-a52b-59497d478345-kube-api-access-jfxzn\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 20:04:26.169001 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.168960    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b48b7668c-2gm2z"]
May 26 20:04:26.169399 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.169271    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ee4e4ef-cbf0-4835-a52b-59497d478345" containerName="manager"
May 26 20:04:26.169399 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.169282    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee4e4ef-cbf0-4835-a52b-59497d478345" containerName="manager"
May 26 20:04:26.169399 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.169376    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ee4e4ef-cbf0-4835-a52b-59497d478345" containerName="manager"
May 26 20:04:26.171744 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.171724    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:26.174407 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.174384    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 20:04:26.174407 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.174399    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m9p4x\""
May 26 20:04:26.180866 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.180843    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-2gm2z"]
May 26 20:04:26.233241 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.233204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6q6\" (UniqueName: \"kubernetes.io/projected/c4d5e159-a6f2-48c1-bde8-3f2c97301820-kube-api-access-tt6q6\") pod \"maas-controller-5b48b7668c-2gm2z\" (UID: \"c4d5e159-a6f2-48c1-bde8-3f2c97301820\") " pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:26.333735 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.333691    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6q6\" (UniqueName: \"kubernetes.io/projected/c4d5e159-a6f2-48c1-bde8-3f2c97301820-kube-api-access-tt6q6\") pod \"maas-controller-5b48b7668c-2gm2z\" (UID: \"c4d5e159-a6f2-48c1-bde8-3f2c97301820\") " pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:26.342501 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.342477    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6q6\" (UniqueName: \"kubernetes.io/projected/c4d5e159-a6f2-48c1-bde8-3f2c97301820-kube-api-access-tt6q6\") pod \"maas-controller-5b48b7668c-2gm2z\" (UID: \"c4d5e159-a6f2-48c1-bde8-3f2c97301820\") " pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:26.483555 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.483452    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:26.620002 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:26.619970    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b48b7668c-2gm2z"]
May 26 20:04:26.622261 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:04:26.622233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d5e159_a6f2_48c1_bde8_3f2c97301820.slice/crio-4063a3ca6bd14ff27d10ba5e15580e96467bb2424fefbe893dcb895680fa9e58 WatchSource:0}: Error finding container 4063a3ca6bd14ff27d10ba5e15580e96467bb2424fefbe893dcb895680fa9e58: Status 404 returned error can't find the container with id 4063a3ca6bd14ff27d10ba5e15580e96467bb2424fefbe893dcb895680fa9e58
May 26 20:04:27.319944 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:27.319909    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ee4e4ef-cbf0-4835-a52b-59497d478345" path="/var/lib/kubelet/pods/3ee4e4ef-cbf0-4835-a52b-59497d478345/volumes"
May 26 20:04:27.367806 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:27.367744    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-2gm2z" event={"ID":"c4d5e159-a6f2-48c1-bde8-3f2c97301820","Type":"ContainerStarted","Data":"3a373688a627be7c5742c855051527eb0cedd58913d31de01588c89368e057ad"}
May 26 20:04:27.367806 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:27.367808    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b48b7668c-2gm2z" event={"ID":"c4d5e159-a6f2-48c1-bde8-3f2c97301820","Type":"ContainerStarted","Data":"4063a3ca6bd14ff27d10ba5e15580e96467bb2424fefbe893dcb895680fa9e58"}
May 26 20:04:27.368011 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:27.367914    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:04:27.386371 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:27.386305    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5b48b7668c-2gm2z" podStartSLOduration=0.870538274 podStartE2EDuration="1.386291085s" podCreationTimestamp="2026-05-26 20:04:26 +0000 UTC" firstStartedPulling="2026-05-26 20:04:26.623677972 +0000 UTC m=+1029.876749944" lastFinishedPulling="2026-05-26 20:04:27.139430782 +0000 UTC m=+1030.392502755" observedRunningTime="2026-05-26 20:04:27.384290349 +0000 UTC m=+1030.637362342" watchObservedRunningTime="2026-05-26 20:04:27.386291085 +0000 UTC m=+1030.639363076"
May 26 20:04:38.377041 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:04:38.377009    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b48b7668c-2gm2z"
May 26 20:14:46.815645 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:46.815603    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 20:14:46.818120 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:46.815840    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" podUID="db63c5e3-930d-4599-ad92-87d0c2536d57" containerName="manager" containerID="cri-o://c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946" gracePeriod=10
May 26 20:14:47.558559 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.558534    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 20:14:47.643705 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.643624    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume\") pod \"db63c5e3-930d-4599-ad92-87d0c2536d57\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") "
May 26 20:14:47.643705 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.643677    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lswlq\" (UniqueName: \"kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq\") pod \"db63c5e3-930d-4599-ad92-87d0c2536d57\" (UID: \"db63c5e3-930d-4599-ad92-87d0c2536d57\") "
May 26 20:14:47.643979 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.643956    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db63c5e3-930d-4599-ad92-87d0c2536d57" (UID: "db63c5e3-930d-4599-ad92-87d0c2536d57"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 20:14:47.645844 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.645815    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq" (OuterVolumeSpecName: "kube-api-access-lswlq") pod "db63c5e3-930d-4599-ad92-87d0c2536d57" (UID: "db63c5e3-930d-4599-ad92-87d0c2536d57"). InnerVolumeSpecName "kube-api-access-lswlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:14:47.744597 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.744560    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db63c5e3-930d-4599-ad92-87d0c2536d57-extensions-socket-volume\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 20:14:47.744597 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:47.744590    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lswlq\" (UniqueName: \"kubernetes.io/projected/db63c5e3-930d-4599-ad92-87d0c2536d57-kube-api-access-lswlq\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 20:14:48.421630 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.421595    2573 generic.go:358] "Generic (PLEG): container finished" podID="db63c5e3-930d-4599-ad92-87d0c2536d57" containerID="c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946" exitCode=0
May 26 20:14:48.422044 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.421660    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"
May 26 20:14:48.422044 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.421679    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" event={"ID":"db63c5e3-930d-4599-ad92-87d0c2536d57","Type":"ContainerDied","Data":"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"}
May 26 20:14:48.422044 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.421721    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8" event={"ID":"db63c5e3-930d-4599-ad92-87d0c2536d57","Type":"ContainerDied","Data":"991c523c34e6af1dc1d038f5af80fdca75ec19ac1614fcba9374f5141e9c68a9"}
May 26 20:14:48.422044 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.421736    2573 scope.go:117] "RemoveContainer" containerID="c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"
May 26 20:14:48.431033 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.431017    2573 scope.go:117] "RemoveContainer" containerID="c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"
May 26 20:14:48.431259 ip-10-0-141-124 kubenswrapper[2573]: E0526 20:14:48.431239    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946\": container with ID starting with c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946 not found: ID does not exist" containerID="c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"
May 26 20:14:48.431300 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.431268    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946"} err="failed to get container status \"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946\": rpc error: code = NotFound desc = could not find container \"c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946\": container with ID starting with c6100f730315fa1f27292c13fe00423c61b93a3be59d675e86fa0e85f3518946 not found: ID does not exist"
May 26 20:14:48.443851 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.443823    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 20:14:48.446460 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:48.446436    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f8ck8"]
May 26 20:14:49.320351 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:14:49.320298    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db63c5e3-930d-4599-ad92-87d0c2536d57" path="/var/lib/kubelet/pods/db63c5e3-930d-4599-ad92-87d0c2536d57/volumes"
May 26 20:15:00.141595 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.141553    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-gplgh"]
May 26 20:15:00.142009 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.141859    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db63c5e3-930d-4599-ad92-87d0c2536d57" containerName="manager"
May 26 20:15:00.142009 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.141871    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="db63c5e3-930d-4599-ad92-87d0c2536d57" containerName="manager"
May 26 20:15:00.142009 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.141932    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="db63c5e3-930d-4599-ad92-87d0c2536d57" containerName="manager"
May 26 20:15:00.146454 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.146434    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:00.149309 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.149285    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pwb2t\""
May 26 20:15:00.152028 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.151984    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-gplgh"]
May 26 20:15:00.158397 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.158372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhw29\" (UniqueName: \"kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29\") pod \"maas-api-key-cleanup-29663775-gplgh\" (UID: \"4765f335-a3b8-43ff-b97b-67201571d0f3\") " pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:00.259631 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.259591    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhw29\" (UniqueName: \"kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29\") pod \"maas-api-key-cleanup-29663775-gplgh\" (UID: \"4765f335-a3b8-43ff-b97b-67201571d0f3\") " pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:00.268098 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.268071    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhw29\" (UniqueName: \"kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29\") pod \"maas-api-key-cleanup-29663775-gplgh\" (UID: \"4765f335-a3b8-43ff-b97b-67201571d0f3\") " pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:00.457565 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.457478    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:00.588955 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.588897    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-gplgh"]
May 26 20:15:00.592129 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:15:00.592085    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4765f335_a3b8_43ff_b97b_67201571d0f3.slice/crio-c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d WatchSource:0}: Error finding container c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d: Status 404 returned error can't find the container with id c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d
May 26 20:15:00.594038 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:00.594016    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:15:01.463541 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:01.463499    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh" event={"ID":"4765f335-a3b8-43ff-b97b-67201571d0f3","Type":"ContainerStarted","Data":"c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d"}
May 26 20:15:05.477439 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:05.477351    2573 generic.go:358] "Generic (PLEG): container finished" podID="4765f335-a3b8-43ff-b97b-67201571d0f3" containerID="53e0be9067122a4eabe64be1bad52c24684c7f635c4097d234574328bf92fa8d" exitCode=0
May 26 20:15:05.477439 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:05.477399    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh" event={"ID":"4765f335-a3b8-43ff-b97b-67201571d0f3","Type":"ContainerDied","Data":"53e0be9067122a4eabe64be1bad52c24684c7f635c4097d234574328bf92fa8d"}
May 26 20:15:06.610477 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:06.610450    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:06.711082 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:06.711044    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhw29\" (UniqueName: \"kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29\") pod \"4765f335-a3b8-43ff-b97b-67201571d0f3\" (UID: \"4765f335-a3b8-43ff-b97b-67201571d0f3\") "
May 26 20:15:06.713171 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:06.713137    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29" (OuterVolumeSpecName: "kube-api-access-lhw29") pod "4765f335-a3b8-43ff-b97b-67201571d0f3" (UID: "4765f335-a3b8-43ff-b97b-67201571d0f3"). InnerVolumeSpecName "kube-api-access-lhw29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:15:06.812200 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:06.812163    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhw29\" (UniqueName: \"kubernetes.io/projected/4765f335-a3b8-43ff-b97b-67201571d0f3-kube-api-access-lhw29\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\""
May 26 20:15:07.484393 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:07.484349    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh"
May 26 20:15:07.484572 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:07.484345    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-gplgh" event={"ID":"4765f335-a3b8-43ff-b97b-67201571d0f3","Type":"ContainerDied","Data":"c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d"}
May 26 20:15:07.484572 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:07.484480    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c071dd68a9d81082f1ff3ed31a96b5f6967f354242adf41d8e8bb5cfb7229b0d"
May 26 20:15:52.936937 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.936896    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"]
May 26 20:15:52.937764 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.937209    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4765f335-a3b8-43ff-b97b-67201571d0f3" containerName="cleanup"
May 26 20:15:52.937764 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.937223    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4765f335-a3b8-43ff-b97b-67201571d0f3" containerName="cleanup"
May 26 20:15:52.937764 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.937289    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="4765f335-a3b8-43ff-b97b-67201571d0f3" containerName="cleanup"
May 26 20:15:52.940048 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.940031    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:52.942670 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.942644    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sd4wx\""
May 26 20:15:52.951079 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:52.951053    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"]
May 26 20:15:53.099192 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.099152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c290f031-f21e-4e68-8bb3-61ee700da74c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.099396 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.099207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tjqq\" (UniqueName: \"kubernetes.io/projected/c290f031-f21e-4e68-8bb3-61ee700da74c-kube-api-access-5tjqq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.200693 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.200595    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tjqq\" (UniqueName: \"kubernetes.io/projected/c290f031-f21e-4e68-8bb3-61ee700da74c-kube-api-access-5tjqq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.200693 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.200701    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c290f031-f21e-4e68-8bb3-61ee700da74c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.201044 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.201028    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c290f031-f21e-4e68-8bb3-61ee700da74c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.209388 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.209362    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tjqq\" (UniqueName: \"kubernetes.io/projected/c290f031-f21e-4e68-8bb3-61ee700da74c-kube-api-access-5tjqq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pqxds\" (UID: \"c290f031-f21e-4e68-8bb3-61ee700da74c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.250494 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.250458    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.398543 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.398511    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"]
May 26 20:15:53.400608 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:15:53.400559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc290f031_f21e_4e68_8bb3_61ee700da74c.slice/crio-03fc9d3e15624ebdb7d4d14761c602ebc7b7c055c4032df9238791f7c5a01aa1 WatchSource:0}: Error finding container 03fc9d3e15624ebdb7d4d14761c602ebc7b7c055c4032df9238791f7c5a01aa1: Status 404 returned error can't find the container with id 03fc9d3e15624ebdb7d4d14761c602ebc7b7c055c4032df9238791f7c5a01aa1
May 26 20:15:53.637867 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.637809    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds" event={"ID":"c290f031-f21e-4e68-8bb3-61ee700da74c","Type":"ContainerStarted","Data":"a3e0aeec08f8216ca0b536187fb3ba534b99a73e163cfff59affe4e2acbeacbb"}
May 26 20:15:53.637867 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.637854    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds" event={"ID":"c290f031-f21e-4e68-8bb3-61ee700da74c","Type":"ContainerStarted","Data":"03fc9d3e15624ebdb7d4d14761c602ebc7b7c055c4032df9238791f7c5a01aa1"}
May 26 20:15:53.638075 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.637955    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:15:53.658576 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:15:53.658518    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds" podStartSLOduration=1.6585044519999999 podStartE2EDuration="1.658504452s" podCreationTimestamp="2026-05-26 20:15:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:15:53.657703933 +0000 UTC m=+1716.910775938" watchObservedRunningTime="2026-05-26 20:15:53.658504452 +0000 UTC m=+1716.911576442"
May 26 20:16:04.643806 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:16:04.643770    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pqxds"
May 26 20:25:44.050040 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:44.050005    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-swsl9_21eb5e72-acd6-4735-8bc4-64f976b162ae/manager/0.log"
May 26 20:25:44.306152 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:44.306076    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663775-gplgh_4765f335-a3b8-43ff-b97b-67201571d0f3/cleanup/0.log"
May 26 20:25:44.432765 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:44.432724    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b48b7668c-2gm2z_c4d5e159-a6f2-48c1-bde8-3f2c97301820/manager/0.log"
May 26 20:25:44.559958 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:44.559880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gnh7d_ee549b8c-8e05-413d-8f25-12655add3335/manager/2.log"
May 26 20:25:44.800778 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:44.800747    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f5b4546-bfqlc_97694e1a-d49c-4fa0-860d-27297972b82d/manager/0.log"
May 26 20:25:46.497573 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:46.497546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-m5d65_1634f0ee-38e2-4a0b-bd5b-1f3168fa679c/manager/0.log"
May 26 20:25:46.974066 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:46.973989    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-pqxds_c290f031-f21e-4e68-8bb3-61ee700da74c/manager/0.log"
May 26 20:25:47.698261 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:47.698228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gvznc_86561178-4d56-431b-bfc9-52cd2e38f097/discovery/0.log"
May 26 20:25:47.920856 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:47.920829    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff7c56cdc-mffrn_e6c058f8-805a-4f81-bb39-57352e62d809/kube-auth-proxy/0.log"
May 26 20:25:48.629608 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:48.629575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c_57ce2a52-c54b-4646-bf0e-6754971714e4/storage-initializer/0.log"
May 26 20:25:48.636773 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:48.636750    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-pwm5c_57ce2a52-c54b-4646-bf0e-6754971714e4/main/0.log"
May 26 20:25:49.016570 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:49.016531    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4_87978cbd-74f7-42d8-b78b-5051fc3849a4/storage-initializer/0.log"
May 26 20:25:49.023114 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:49.023091    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccqc7x4_87978cbd-74f7-42d8-b78b-5051fc3849a4/main/0.log"
May 26 20:25:56.871387 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:56.871348    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cbmjp_f4c607f4-ca87-49a5-b2f7-617adc43670f/global-pull-secret-syncer/0.log"
May 26 20:25:57.030090 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:57.030056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hsnfw_666d711f-a243-4c7c-92db-4755fd228618/konnectivity-agent/0.log"
May 26 20:25:57.108554 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:25:57.108517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-124.ec2.internal_c79021a0492f565e688380e70be739c1/haproxy/0.log"
May 26 20:26:01.658088 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:01.658053    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-m5d65_1634f0ee-38e2-4a0b-bd5b-1f3168fa679c/manager/0.log"
May 26 20:26:01.815680 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:01.815649    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-pqxds_c290f031-f21e-4e68-8bb3-61ee700da74c/manager/0.log"
May 26 20:26:03.799718 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:03.799688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4tnc_4e579868-b9d9-460e-8275-e0c6b2bc4595/node-exporter/0.log"
May 26 20:26:03.821822 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:03.821784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4tnc_4e579868-b9d9-460e-8275-e0c6b2bc4595/kube-rbac-proxy/0.log"
May 26 20:26:03.844930 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:03.844904    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k4tnc_4e579868-b9d9-460e-8275-e0c6b2bc4595/init-textfile/0.log"
May 26 20:26:05.817045 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.817013    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"]
May 26 20:26:05.819183 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.819165    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:05.822004 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.821972    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bhxcr\"/\"kube-root-ca.crt\""
May 26 20:26:05.822114 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.822014    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bhxcr\"/\"openshift-service-ca.crt\""
May 26 20:26:05.823101 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.823084    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bhxcr\"/\"default-dockercfg-gz497\""
May 26 20:26:05.831352 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:05.831309    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"]
May 26 20:26:06.003762 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.003718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bdc\" (UniqueName: \"kubernetes.io/projected/665c40f9-9962-4c7e-9b97-e3263d81f620-kube-api-access-k6bdc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.003762 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.003766    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-lib-modules\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.003996 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.003827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-podres\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.003996 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.003877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-sys\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.003996 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.003919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-proc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.104915 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.104809    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bdc\" (UniqueName: \"kubernetes.io/projected/665c40f9-9962-4c7e-9b97-e3263d81f620-kube-api-access-k6bdc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.104915 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.104852    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-lib-modules\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.104915 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.104883    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-podres\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.104915 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.104918    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-sys\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.105207 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.104969    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-proc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.105207 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.105018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-lib-modules\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.105207 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.105028    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-sys\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.105207 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.105039    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-podres\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.105207 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.105054    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/665c40f9-9962-4c7e-9b97-e3263d81f620-proc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.115131 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.115082    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bdc\" (UniqueName: \"kubernetes.io/projected/665c40f9-9962-4c7e-9b97-e3263d81f620-kube-api-access-k6bdc\") pod \"perf-node-gather-daemonset-cmg2h\" (UID: \"665c40f9-9962-4c7e-9b97-e3263d81f620\") " pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.128928 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.128895    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.262265 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.262240    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"]
May 26 20:26:06.265169 ip-10-0-141-124 kubenswrapper[2573]: W0526 20:26:06.265139    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod665c40f9_9962_4c7e_9b97_e3263d81f620.slice/crio-4b87bb84269d3168abaf36d30a53055a58e3ab1d595a8c00f7b5ecbdce9db5a1 WatchSource:0}: Error finding container 4b87bb84269d3168abaf36d30a53055a58e3ab1d595a8c00f7b5ecbdce9db5a1: Status 404 returned error can't find the container with id 4b87bb84269d3168abaf36d30a53055a58e3ab1d595a8c00f7b5ecbdce9db5a1
May 26 20:26:06.267316 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.267293    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:26:06.694273 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.694235    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h" event={"ID":"665c40f9-9962-4c7e-9b97-e3263d81f620","Type":"ContainerStarted","Data":"cebe41f3df8ff36e7b1c050c45a1857a6a362185d1b7472293f4e51917100ddb"}
May 26 20:26:06.694273 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.694271    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h" event={"ID":"665c40f9-9962-4c7e-9b97-e3263d81f620","Type":"ContainerStarted","Data":"4b87bb84269d3168abaf36d30a53055a58e3ab1d595a8c00f7b5ecbdce9db5a1"}
May 26 20:26:06.694524 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.694373    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:06.713478 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:06.713400    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h" podStartSLOduration=1.713380366 podStartE2EDuration="1.713380366s" podCreationTimestamp="2026-05-26 20:26:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:26:06.71185506 +0000 UTC m=+2329.964927052" watchObservedRunningTime="2026-05-26 20:26:06.713380366 +0000 UTC m=+2329.966452364"
May 26 20:26:08.315635 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:08.315601    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfww2_68ac85af-0e48-492b-ba27-b92c551b354c/dns/0.log"
May 26 20:26:08.379030 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:08.378994    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lfww2_68ac85af-0e48-492b-ba27-b92c551b354c/kube-rbac-proxy/0.log"
May 26 20:26:08.533920 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:08.533889    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-srzdg_86d43817-1b3e-4e9e-a80f-13fdc2301ff2/dns-node-resolver/0.log"
May 26 20:26:09.229787 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:09.229754    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8t95_9f94ddcb-68c9-4425-acfc-46ff8a3c55c5/node-ca/0.log"
May 26 20:26:10.370381 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:10.370341    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gvznc_86561178-4d56-431b-bfc9-52cd2e38f097/discovery/0.log"
May 26 20:26:10.421670 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:10.421640    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff7c56cdc-mffrn_e6c058f8-805a-4f81-bb39-57352e62d809/kube-auth-proxy/0.log"
May 26 20:26:11.129583 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:11.129551    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pgkrz_88d3c016-26a7-4b39-a6c3-ffc80af1a582/serve-healthcheck-canary/0.log"
May 26 20:26:11.722726 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:11.722701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttrzg_e5653c64-341c-465b-bdc9-0af1496ca68b/kube-rbac-proxy/0.log"
May 26 20:26:11.743295 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:11.743262    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttrzg_e5653c64-341c-465b-bdc9-0af1496ca68b/exporter/0.log"
May 26 20:26:11.763028 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:11.762990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttrzg_e5653c64-341c-465b-bdc9-0af1496ca68b/extractor/0.log"
May 26 20:26:12.707568 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:12.707542    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bhxcr/perf-node-gather-daemonset-cmg2h"
May 26 20:26:13.772046 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.772012    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-swsl9_21eb5e72-acd6-4735-8bc4-64f976b162ae/manager/0.log"
May 26 20:26:13.831430 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.831401    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663775-gplgh_4765f335-a3b8-43ff-b97b-67201571d0f3/cleanup/0.log"
May 26 20:26:13.901652 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.901616    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b48b7668c-2gm2z_c4d5e159-a6f2-48c1-bde8-3f2c97301820/manager/0.log"
May 26 20:26:13.919526 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.919503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gnh7d_ee549b8c-8e05-413d-8f25-12655add3335/manager/1.log"
May 26 20:26:13.931551 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.931523    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gnh7d_ee549b8c-8e05-413d-8f25-12655add3335/manager/2.log"
May 26 20:26:13.996964 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:13.996929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665f5b4546-bfqlc_97694e1a-d49c-4fa0-860d-27297972b82d/manager/0.log"
May 26 20:26:21.230155 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.230124    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/kube-multus-additional-cni-plugins/0.log"
May 26 20:26:21.250094 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.250065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/egress-router-binary-copy/0.log"
May 26 20:26:21.270830 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.270801    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/cni-plugins/0.log"
May 26 20:26:21.291361 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.291334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/bond-cni-plugin/0.log"
May 26 20:26:21.312920 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.312888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/routeoverride-cni/0.log"
May 26 20:26:21.332575 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.332552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/whereabouts-cni-bincopy/0.log"
May 26 20:26:21.352181 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.352148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ncsts_cfeecbfd-f4ab-49a3-b56a-0807652fe579/whereabouts-cni/0.log"
May 26 20:26:21.571276 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.571248    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n4j9m_36310e62-1a62-4017-ac21-832155523b06/kube-multus/0.log"
May 26 20:26:21.681582 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.681551    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmt5b_42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4/network-metrics-daemon/0.log"
May 26 20:26:21.707199 ip-10-0-141-124 kubenswrapper[2573]: I0526 20:26:21.707177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmt5b_42c9c5a0-7ca1-412f-880c-fc7a46f9e5d4/kube-rbac-proxy/0.log"